Jun 13 05:24:34.068534 ip-10-0-130-198 systemd[1]: Starting Kubernetes Kubelet... Jun 13 05:24:34.490387 ip-10-0-130-198 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 05:24:34.490387 ip-10-0-130-198 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 05:24:34.490387 ip-10-0-130-198 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 05:24:34.490387 ip-10-0-130-198 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 05:24:34.490387 ip-10-0-130-198 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 05:24:34.491482 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.491308 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 05:24:34.495629 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495613 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:34.495629 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495628 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495632 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495636 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495639 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495642 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495646 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495649 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495652 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495655 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495664 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495667 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495669 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495672 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495675 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495677 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495680 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495682 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495685 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495688 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:34.495691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495690 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495693 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495696 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495699 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495702 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495704 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495707 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495710 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495713 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495715 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495718 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495720 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495723 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495725 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495728 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495731 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495733 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495736 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495738 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495741 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:34.496150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495745 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495749 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495751 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495754 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495757 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495759 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495762 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495764 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495767 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495769 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495772 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495774 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495777 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495781 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495786 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495789 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495794 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495798 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495801 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:34.496691 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495804 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495807 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495809 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495812 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495814 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495817 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495821 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495824 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495827 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495829 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495832 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495835 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495837 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495840 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495843 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495845 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495848 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495851 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495854 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495856 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:34.497154 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495858 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495861 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495863 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495866 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495869 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495871 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495874 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495877 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495880 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495883 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495885 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495888 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495890 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495893 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495896 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495898 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495900 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495903 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495905 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:34.497974 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.495908 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:34.499409 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499391 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:34.499409 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499408 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499413 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499416 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499419 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499422 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499425 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499428 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499431 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499434 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499436 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499439 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499442 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499445 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499447 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499450 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499453 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499455 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499458 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499460 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499463 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:34.499496 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499466 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499468 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499471 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499477 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499479 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499483 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499487 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499490 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499493 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499496 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499500 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499504 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499508 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499511 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499514 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499517 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499520 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499523 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499526 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:34.499998 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499529 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499532 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499534 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499537 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499540 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499543 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499546 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499548 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499551 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499553 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499556 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499559 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499563 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499565 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499568 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499572 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499574 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499577 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499580 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499583 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:34.500486 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499586 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499588 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499591 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499594 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499596 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499599 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499601 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499604 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499607 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499609 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499612 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499614 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499620 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499624 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499626 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499629 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499632 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499634 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499637 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499639 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:34.501008 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499642 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499644 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499647 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499650 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499653 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499656 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499658 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499661 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499664 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499666 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499669 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499672 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499674 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499677 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499679 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499682 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499685 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499687 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.499690 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500056 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:34.501520 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500061 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500064 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500067 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500069 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500074 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500076 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500079 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500082 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500085 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500087 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500090 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500093 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500096 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500099 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500101 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500104 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500108 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500112 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500115 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500117 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:34.502011 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500120 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500123 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500126 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500128 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500131 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500135 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500138 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500141 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500144 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500147 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500150 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500153 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500156 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500159 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500161 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500164 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500168 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500170 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500173 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:34.502558 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500176 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500178 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500181 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500183 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500187 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500190 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500192 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500195 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500197 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500200 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500203 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500205 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500208 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500210 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500213 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500215 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500218 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500222 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500225 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:34.503047 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500228 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500231 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500234 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500236 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500258 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500262 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500264 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500267 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500270 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500273 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500277 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500279 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500282 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500284 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500289 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500291 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500294 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500297 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500299 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500302 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:34.503525 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500304 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500307 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500310 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500313 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500316 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500318 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500321 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500324 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500327 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500329 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500331 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500334 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500336 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500339 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500342 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500344 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500347 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500349 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500352 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.500354 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:34.504111 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500422 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500429 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500438 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500445 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500451 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500454 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500458 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500462 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500467 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500470 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500473 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500477 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500480 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500483 2566 flags.go:64] FLAG: --cgroup-root="" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500486 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500490 2566 flags.go:64] FLAG: --client-ca-file="" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500494 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500497 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500501 2566 flags.go:64] FLAG: --cluster-domain="" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500504 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500507 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500510 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500514 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500522 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 05:24:34.504621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500525 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500528 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500531 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500534 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500537 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500540 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500543 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500546 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500550 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500553 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500557 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500560 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500563 2566 flags.go:64] FLAG: --enable-server="true" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500566 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500571 2566 flags.go:64] FLAG: --event-burst="100" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500574 2566 flags.go:64] FLAG: --event-qps="50" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500577 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500580 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500583 2566 flags.go:64] FLAG: --eviction-hard="" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500586 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500590 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500592 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500595 2566 flags.go:64] FLAG: --eviction-soft="" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500598 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500601 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 05:24:34.505185 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500604 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500607 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500610 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500613 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500615 2566 flags.go:64] FLAG: --feature-gates="" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500619 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500622 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500625 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500628 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500631 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500634 2566 flags.go:64] FLAG: --help="false" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500637 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500640 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500643 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500646 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500649 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500652 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500656 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500659 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500661 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500664 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500667 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500670 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500673 2566 flags.go:64] FLAG: --kube-reserved="" Jun 13 05:24:34.505824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500676 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500678 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500681 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500684 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500687 2566 flags.go:64] FLAG: --lock-file="" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500690 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500693 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500696 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500701 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500704 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500707 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500709 2566 flags.go:64] FLAG: --logging-format="text" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500712 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500716 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500718 2566 flags.go:64] FLAG: --manifest-url="" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500721 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500725 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500728 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500731 2566 flags.go:64] FLAG: --max-pods="110" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500734 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500737 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500743 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500746 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500749 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500752 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 05:24:34.506443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500755 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500762 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500765 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500768 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500771 2566 flags.go:64] FLAG: --pod-cidr="" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500774 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500780 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500783 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500786 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500789 2566 flags.go:64] FLAG: --port="10250" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500792 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500795 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cbdfdb4ac4e28631" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500798 2566 flags.go:64] FLAG: --qos-reserved="" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500801 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500804 2566 flags.go:64] FLAG: --register-node="true" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500807 2566 flags.go:64] FLAG: --register-with-taints="" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500810 2566 flags.go:64] FLAG: --registry-burst="10" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500814 2566 flags.go:64] FLAG: --registry-qps="5" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500817 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500819 2566 flags.go:64] FLAG: --reserved-memory="" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500823 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500826 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500829 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500832 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500835 2566 flags.go:64] FLAG: --runonce="false" Jun 13 05:24:34.507076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500837 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500841 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500844 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500846 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500850 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500853 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500857 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500860 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500863 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500865 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500868 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500871 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500874 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500877 2566 flags.go:64] FLAG: --system-cgroups="" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500880 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500885 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500888 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500891 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500894 2566 flags.go:64] FLAG: --tls-min-version="" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500897 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500900 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500902 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500905 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500908 2566 flags.go:64] FLAG: --v="2" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500912 2566 flags.go:64] FLAG: --version="false" Jun 13 05:24:34.508080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500916 2566 flags.go:64] FLAG: --vmodule="" Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500919 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.500923 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501030 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501034 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501037 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501040 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501044 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501048 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501051 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501053 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501057 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501060 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501064 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501067 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501070 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501072 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501075 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501078 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501080 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:34.509136 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501083 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501086 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501090 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501093 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501096 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501099 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501102 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501105 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501108 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501110 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501113 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501116 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501118 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501121 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501124 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501126 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501129 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501132 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501134 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:34.509865 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501137 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501140 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501142 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501145 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501150 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501152 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501156 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501159 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501162 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501164 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501167 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501169 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501172 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501174 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501177 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501180 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501182 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501185 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501188 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:34.510363 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501190 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501193 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501196 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501198 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501201 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501203 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501206 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501208 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501211 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501214 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501216 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501219 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501221 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501224 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501226 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501229 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501231 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501235 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501253 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501258 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:34.511077 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501260 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501263 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501266 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501270 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501274 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501277 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501279 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501282 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501285 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501287 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501290 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501293 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501295 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501298 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501300 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501303 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501306 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501309 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501311 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501314 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:34.511995 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501317 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501320 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501323 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.501325 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.501875 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.509515 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.509673 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.510547 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.510565 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510654 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510661 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510667 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510672 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510677 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510681 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:34.512545 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510685 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510690 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510694 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510699 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510704 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510708 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510712 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510717 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510721 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510726 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510730 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510734 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510738 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510743 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510747 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510752 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510779 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510787 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510792 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510798 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:34.513114 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510803 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510807 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510811 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510818 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510822 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510827 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510831 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510835 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510840 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510845 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510849 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510853 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510857 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510861 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510865 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510869 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510874 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510878 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510882 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510887 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:34.513680 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510891 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510895 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510900 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510904 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510911 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510917 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510922 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510926 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510931 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510935 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510939 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510944 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510948 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510952 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510956 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510961 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510966 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510973 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510978 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:34.514163 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510983 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510988 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510993 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.510997 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511001 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511006 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511010 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511014 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511018 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511022 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511027 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511031 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511035 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511039 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511043 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511047 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511052 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511056 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511060 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:34.514978 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511064 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511069 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511075 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511081 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511085 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511089 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511093 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511097 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511101 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511106 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511110 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511116 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511120 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511125 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511129 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:34.515569 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.511137 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511327 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511337 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511342 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511347 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511353 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511357 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511362 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511367 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511371 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511375 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511379 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511384 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511389 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511393 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511397 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511401 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511405 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511409 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511413 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:34.516066 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511417 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511421 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511425 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511429 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511433 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511437 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511459 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511465 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511470 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511476 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511481 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511485 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511490 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511496 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511503 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511508 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511513 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511517 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:34.516708 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511521 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511525 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511529 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511533 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511537 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511541 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511546 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511550 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511554 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511558 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511562 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511567 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511571 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511575 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511580 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511586 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511592 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511597 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511601 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511606 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:34.517150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511610 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511614 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511619 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511623 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511629 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511633 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511638 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511643 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511647 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511652 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511656 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511660 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511664 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511668 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511672 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511676 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511681 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511685 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511689 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511694 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:34.517649 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511698 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511702 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511707 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511711 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511715 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511719 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511724 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511728 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511732 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511737 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511741 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511744 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511749 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511753 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511757 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511761 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511765 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511770 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511775 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:34.518138 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511779 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511785 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:34.511790 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.511798 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.511945 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.515701 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.517199 2566 server.go:1019] "Starting client certificate rotation" Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.517267 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 05:24:34.518610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.517303 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 05:24:34.521993 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.521980 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 05:24:34.523147 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.523126 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 05:24:34.536039 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.536024 2566 log.go:25] "Validated CRI v1 runtime API" Jun 13 05:24:34.540807 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.540790 2566 log.go:25] "Validated CRI v1 image API" Jun 13 05:24:34.541580 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.541565 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 05:24:34.543902 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.543883 2566 fs.go:135] Filesystem UUIDs: map[31f29184-641e-4320-a057-dc6bed4066a7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9b39eaa8-d99b-41c2-845f-bebc2865f3cf:/dev/nvme0n1p3] Jun 13 05:24:34.543976 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.543901 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 05:24:34.544941 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.544926 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 05:24:34.549030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.548925 2566 manager.go:216] Machine: {Timestamp:2026-06-13 05:24:34.547509663 +0000 UTC m=+0.357482321 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102848 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f73f6d27392a8334999abdbc3538 SystemUUID:ec25f73f-6d27-392a-8334-999abdbc3538 BootID:a3eb5832-888e-46b3-ad61-c1e73c447db6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:60:7b:6d:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:60:7b:6d:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:6c:c9:ca:51:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 05:24:34.549030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.549025 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 05:24:34.549145 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.549125 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 05:24:34.553232 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.553212 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 05:24:34.553387 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.553235 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 05:24:34.554979 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.554968 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 05:24:34.555011 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.554981 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 05:24:34.555011 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.554989 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 05:24:34.555729 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.555719 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 05:24:34.557008 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.556998 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 05:24:34.560062 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560051 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 13 05:24:34.560175 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560165 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 05:24:34.560206 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560195 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 13 05:24:34.560233 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560206 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 05:24:34.560233 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560226 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 05:24:34.560310 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560256 2566 kubelet.go:398] "Adding apiserver pod source" Jun 13 05:24:34.560310 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560270 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 05:24:34.560586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560575 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 05:24:34.560627 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.560594 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 05:24:34.562997 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.562980 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 05:24:34.564296 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564282 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 05:24:34.564357 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564312 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 05:24:34.564503 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564493 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 05:24:34.564541 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564508 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 05:24:34.564541 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564514 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 05:24:34.564541 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564519 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 05:24:34.564541 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564527 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 05:24:34.564541 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564532 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 05:24:34.564669 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.564659 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9wg4" Jun 13 05:24:34.565276 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.565266 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 05:24:34.565276 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.565276 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 05:24:34.565330 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.565282 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 05:24:34.565330 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.565289 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 05:24:34.565330 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.565303 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 05:24:34.565330 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.565311 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 05:24:34.567052 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.567041 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 05:24:34.567052 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.567051 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 05:24:34.569172 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.569146 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 05:24:34.569366 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.569344 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 05:24:34.569413 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.569387 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 05:24:34.570199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.570178 2566 server.go:1268] "Started kubelet" Jun 13 05:24:34.570371 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.570340 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 05:24:34.570659 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.570468 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 05:24:34.570957 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.570928 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 05:24:34.571228 ip-10-0-130-198 systemd[1]: Started Kubernetes Kubelet. Jun 13 05:24:34.572209 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.572194 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 13 05:24:34.572622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.572590 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 05:24:34.573006 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.572988 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9wg4" Jun 13 05:24:34.575822 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.574853 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-198.ec2.internal.18b88ca0ba1d0411 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-198.ec2.internal,UID:ip-10-0-130-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-198.ec2.internal,},FirstTimestamp:2026-06-13 05:24:34.570150929 +0000 UTC m=+0.380123602,LastTimestamp:2026-06-13 05:24:34.570150929 +0000 UTC m=+0.380123602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-198.ec2.internal,}" Jun 13 05:24:34.577330 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.577310 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 05:24:34.579034 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.579016 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 05:24:34.579115 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.579038 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 05:24:34.579179 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.579088 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:34.579838 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.579819 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 05:24:34.579901 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.579856 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 05:24:34.579901 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.579866 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 05:24:34.580088 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.580071 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 13 05:24:34.580088 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.580088 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 13 05:24:34.580931 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.580913 2566 factory.go:55] Registering systemd factory Jun 13 05:24:34.581025 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.580936 2566 factory.go:223] Registration of the systemd container factory successfully Jun 13 05:24:34.581454 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.581438 2566 factory.go:153] Registering CRI-O factory Jun 13 05:24:34.581454 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.581456 2566 factory.go:223] Registration of the crio container factory successfully Jun 13 05:24:34.581585 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.581525 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 05:24:34.581585 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.581547 2566 factory.go:103] Registering Raw factory Jun 13 05:24:34.581585 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.581573 2566 manager.go:1196] Started watching for new ooms in manager Jun 13 05:24:34.582317 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.582300 2566 manager.go:349] Starting recovery of all containers Jun 13 05:24:34.589538 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.589515 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:34.592739 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.592711 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-198.ec2.internal\" not found" node="ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.593501 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.593480 2566 manager.go:354] Recovery completed Jun 13 05:24:34.597820 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.597805 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.600087 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600070 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.600168 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600101 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.600168 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600111 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.600600 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600587 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 05:24:34.600660 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600600 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 05:24:34.600660 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600616 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 13 05:24:34.600719 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.600592 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.601333 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.601319 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.601376 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.601346 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.601376 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.601358 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.601716 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.601705 2566 policy_none.go:49] "None policy: Start" Jun 13 05:24:34.601745 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.601722 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 05:24:34.601745 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.601732 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 05:24:34.602857 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.602847 2566 policy_none.go:47] "Start" Jun 13 05:24:34.625388 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625375 2566 manager.go:337] "Starting Device Plugin manager" Jun 13 05:24:34.625498 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.625430 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 05:24:34.625498 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625444 2566 server.go:87] "Starting device plugin registration server" Jun 13 05:24:34.625701 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625682 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 05:24:34.625749 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625707 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 05:24:34.626347 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625880 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 05:24:34.626347 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625949 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 05:24:34.626347 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.625958 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 05:24:34.626347 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.626342 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 05:24:34.626556 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.626386 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:34.641776 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.641747 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 05:24:34.646037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.642846 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 05:24:34.646037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.642876 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 05:24:34.646037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.642898 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 05:24:34.646037 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.642954 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 05:24:34.646037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.645034 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:34.726598 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.726569 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.727403 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.727389 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.727477 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.727414 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.727477 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.727425 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.727477 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.727445 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.736017 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.735998 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.736017 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.736018 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-198.ec2.internal\": node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:34.743852 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.743809 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal"] Jun 13 05:24:34.743925 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.743872 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.745304 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.745289 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.745382 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.745316 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.745382 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.745329 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.746716 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.746702 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.746811 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.746796 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.746866 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.746824 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.748091 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.748070 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.748182 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.748099 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.748182 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.748114 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.748474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.748452 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.748565 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.748485 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.748565 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.748498 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.748668 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.748587 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:34.749422 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.749409 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.749469 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.749432 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:34.750022 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.750006 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:34.750082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.750035 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:34.750082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.750049 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:34.773858 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.773838 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-198.ec2.internal\" not found" node="ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.778047 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.778029 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-198.ec2.internal\" not found" node="ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.780956 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.780941 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/325dc2cb6d43f6fe0a18472a3561b341-config\") pod \"kube-apiserver-proxy-ip-10-0-130-198.ec2.internal\" (UID: \"325dc2cb6d43f6fe0a18472a3561b341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.781008 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.780963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fe66e8e3119d6c8dde4b22554a082ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal\" (UID: \"1fe66e8e3119d6c8dde4b22554a082ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.781008 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.780980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fe66e8e3119d6c8dde4b22554a082ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal\" (UID: \"1fe66e8e3119d6c8dde4b22554a082ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.849539 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.849520 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:34.881784 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.881765 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/325dc2cb6d43f6fe0a18472a3561b341-config\") pod \"kube-apiserver-proxy-ip-10-0-130-198.ec2.internal\" (UID: \"325dc2cb6d43f6fe0a18472a3561b341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.881841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.881788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fe66e8e3119d6c8dde4b22554a082ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal\" (UID: \"1fe66e8e3119d6c8dde4b22554a082ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.881841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.881805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fe66e8e3119d6c8dde4b22554a082ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal\" (UID: \"1fe66e8e3119d6c8dde4b22554a082ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.881906 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.881841 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fe66e8e3119d6c8dde4b22554a082ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal\" (UID: \"1fe66e8e3119d6c8dde4b22554a082ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.881906 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.881862 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/325dc2cb6d43f6fe0a18472a3561b341-config\") pod \"kube-apiserver-proxy-ip-10-0-130-198.ec2.internal\" (UID: \"325dc2cb6d43f6fe0a18472a3561b341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.881906 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:34.881876 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fe66e8e3119d6c8dde4b22554a082ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal\" (UID: \"1fe66e8e3119d6c8dde4b22554a082ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:34.949932 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:34.949900 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:35.050470 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.050450 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:35.075750 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.075733 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:35.081719 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.081703 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" Jun 13 05:24:35.150586 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.150564 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:35.250970 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.250942 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:35.351424 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.351370 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-198.ec2.internal\" not found" Jun 13 05:24:35.412443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.412421 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:35.480540 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.480519 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" Jun 13 05:24:35.481314 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.481296 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:35.490309 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.490294 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 05:24:35.491345 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.491333 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" Jun 13 05:24:35.501941 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.501918 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 05:24:35.516055 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.516026 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 05:24:35.516140 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.516125 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 05:24:35.516177 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.516161 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 05:24:35.516212 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.516168 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 05:24:35.516212 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.516180 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 05:24:35.561129 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.561110 2566 apiserver.go:52] "Watching apiserver" Jun 13 05:24:35.579422 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.579404 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 05:24:35.579505 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.579418 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 05:19:34 +0000 UTC" deadline="2028-01-17 19:05:00.759420735 +0000 UTC" Jun 13 05:24:35.579505 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.579462 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14005h40m25.179962013s" Jun 13 05:24:35.580097 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.580077 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 05:24:35.582036 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.582013 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-62lwn","kube-system/global-pull-secret-syncer-2bpsg","openshift-image-registry/node-ca-m982k","openshift-multus/multus-8j6jw","openshift-multus/network-metrics-daemon-lvpgj","openshift-network-diagnostics/network-check-target-ws94t","openshift-ovn-kubernetes/ovnkube-node-ccnvt","kube-system/konnectivity-agent-hxz5z","kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g","openshift-cluster-node-tuning-operator/tuned-vngrj","openshift-dns/node-resolver-b7lgq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal","openshift-multus/multus-additional-cni-plugins-kcrjt"] Jun 13 05:24:35.583539 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.583522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.585023 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.584997 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.586216 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.586201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.586625 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.586609 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 05:24:35.586625 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.586616 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 05:24:35.587319 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.587610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587585 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 05:24:35.587689 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587600 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.587827 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587813 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 05:24:35.587930 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587866 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kqcjw\"" Jun 13 05:24:35.587930 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587897 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.588035 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.587986 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.588035 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.588023 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.588126 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.588105 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dwwzg\"" Jun 13 05:24:35.588841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.588826 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 05:24:35.589180 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.589158 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:35.589294 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.589198 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.589294 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.589237 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.589294 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.589260 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:35.589294 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.589270 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qpc4d\"" Jun 13 05:24:35.589486 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.589475 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.591758 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.591738 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.591852 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.591764 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 05:24:35.592029 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.592010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:35.592133 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.592085 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9tnx7\"" Jun 13 05:24:35.592133 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.592089 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:35.592259 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.592221 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 05:24:35.593866 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.593848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.594175 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.594158 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 05:24:35.595043 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.595027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.596199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.596171 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-br4tr\"" Jun 13 05:24:35.596301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.596254 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 05:24:35.596301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.596265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.596301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.596273 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 05:24:35.596456 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.596324 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:35.597197 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.597181 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 05:24:35.597284 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.597220 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 05:24:35.597284 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.597266 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6kf2k\"" Jun 13 05:24:35.597536 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.597520 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.598974 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.598900 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.599674 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.599656 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.599817 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.599802 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.599887 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.599850 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ndqk6\"" Jun 13 05:24:35.600097 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.600078 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 05:24:35.600175 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.600124 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.601343 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.601327 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 05:24:35.601500 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.601458 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.601500 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.601492 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.601606 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.601458 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pmb4n\"" Jun 13 05:24:35.602457 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.602441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 05:24:35.602556 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.602508 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 05:24:35.602656 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.602642 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68l9t\"" Jun 13 05:24:35.611868 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.611846 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw7k6" Jun 13 05:24:35.618721 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.618694 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw7k6" Jun 13 05:24:35.681282 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.681257 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 05:24:35.684620 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-slash\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.684711 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684625 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-node-log\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.684711 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-ovnkube-config\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.684711 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684654 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-conf-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.684711 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-477lc\" (UniqueName: \"kubernetes.io/projected/6ddddc73-e38f-48b8-ac72-ece19246ba96-kube-api-access-477lc\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63212e1d-8ecf-438b-ba7c-00dd6809dec4-dbus\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-host\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-tuned\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pdb\" (UniqueName: \"kubernetes.io/projected/609720d4-d6e9-4331-a538-74d1ac2b7d73-kube-api-access-c9pdb\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-etc-selinux\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-ovn\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.684908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-os-release\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-device-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684951 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-sys-fs\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.684980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-systemd\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685043 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-cni-binary-copy\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-socket-dir-parent\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-cni-multus\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpbb4\" (UniqueName: \"kubernetes.io/projected/806644ce-16a7-4599-be11-4bf2634a2bd5-kube-api-access-zpbb4\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-system-cni-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-hostroot\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysconfig\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-sys\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.685274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-lib-modules\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7207946-297b-4717-9bc1-f8881a1fe3de-serviceca\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-registration-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685333 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-systemd-units\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-env-overrides\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-cnibin\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-cni-bin\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkmv\" (UniqueName: \"kubernetes.io/projected/377177fc-ec9e-493e-8f6d-7ec009fd59a8-kube-api-access-hqkmv\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskqw\" (UniqueName: \"kubernetes.io/projected/93bc553b-de82-4307-93d9-b909bcbe2069-kube-api-access-bskqw\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-k8s-cni-cncf-io\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-cnibin\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ddddc73-e38f-48b8-ac72-ece19246ba96-tmp-dir\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-kubelet\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.685743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-etc-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685609 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-ovnkube-script-lib\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-etc-kubernetes\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-var-lib-kubelet\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685655 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-cni-bin\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-cni-netd\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685731 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63212e1d-8ecf-438b-ba7c-00dd6809dec4-kubelet-config\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7207946-297b-4717-9bc1-f8881a1fe3de-host\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0985ac6-dfbb-4351-a385-948cf5f06462-ovn-node-metrics-cert\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-netns\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685795 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-daemon-config\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/377177fc-ec9e-493e-8f6d-7ec009fd59a8-iptables-alerter-script\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/377177fc-ec9e-493e-8f6d-7ec009fd59a8-host-slash\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-var-lib-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-kubelet\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/609720d4-d6e9-4331-a538-74d1ac2b7d73-tmp\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.685985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/340a413f-7c23-4de1-9aaf-bf0efacbd63d-konnectivity-ca\") pod \"konnectivity-agent-hxz5z\" (UID: \"340a413f-7c23-4de1-9aaf-bf0efacbd63d\") " pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-os-release\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-cni-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8l4\" (UniqueName: \"kubernetes.io/projected/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-kube-api-access-5k8l4\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-kubernetes\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysctl-conf\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-run\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxrl8\" (UniqueName: \"kubernetes.io/projected/f7207946-297b-4717-9bc1-f8881a1fe3de-kube-api-access-wxrl8\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ddddc73-e38f-48b8-ac72-ece19246ba96-hosts-file\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-run-netns\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-run-ovn-kubernetes\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9s5x\" (UniqueName: \"kubernetes.io/projected/c0985ac6-dfbb-4351-a385-948cf5f06462-kube-api-access-b9s5x\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-socket-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.686982 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jccz\" (UniqueName: \"kubernetes.io/projected/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-kube-api-access-5jccz\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-multus-certs\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-modprobe-d\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-systemd\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/340a413f-7c23-4de1-9aaf-bf0efacbd63d-agent-certs\") pod \"konnectivity-agent-hxz5z\" (UID: \"340a413f-7c23-4de1-9aaf-bf0efacbd63d\") " pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-log-socket\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:35.687474 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.686538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysctl-d\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.707057 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.706915 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325dc2cb6d43f6fe0a18472a3561b341.slice/crio-8f69e82a3c43c61ebb5131947498e76fc937eb213b5547d24caf447e1a091ac1 WatchSource:0}: Error finding container 8f69e82a3c43c61ebb5131947498e76fc937eb213b5547d24caf447e1a091ac1: Status 404 returned error can't find the container with id 8f69e82a3c43c61ebb5131947498e76fc937eb213b5547d24caf447e1a091ac1 Jun 13 05:24:35.707296 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.707275 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe66e8e3119d6c8dde4b22554a082ea.slice/crio-3b7544655e3c3cb60d2ab3ef388d81c881d7afe7f941c255d7ef7bc291d635c7 WatchSource:0}: Error finding container 3b7544655e3c3cb60d2ab3ef388d81c881d7afe7f941c255d7ef7bc291d635c7: Status 404 returned error can't find the container with id 3b7544655e3c3cb60d2ab3ef388d81c881d7afe7f941c255d7ef7bc291d635c7 Jun 13 05:24:35.712993 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.712968 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:24:35.787044 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.787044 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-k8s-cni-cncf-io\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-cnibin\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ddddc73-e38f-48b8-ac72-ece19246ba96-tmp-dir\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-kubelet\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-etc-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787121 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-k8s-cni-cncf-io\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787147 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-ovnkube-script-lib\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787155 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-cnibin\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-etc-kubernetes\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-etc-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-kubelet\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787224 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-var-lib-kubelet\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-etc-kubernetes\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-cni-bin\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-var-lib-kubelet\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-cni-netd\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-cni-bin\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-cni-netd\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63212e1d-8ecf-438b-ba7c-00dd6809dec4-kubelet-config\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7207946-297b-4717-9bc1-f8881a1fe3de-host\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787381 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0985ac6-dfbb-4351-a385-948cf5f06462-ovn-node-metrics-cert\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-netns\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63212e1d-8ecf-438b-ba7c-00dd6809dec4-kubelet-config\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7207946-297b-4717-9bc1-f8881a1fe3de-host\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-daemon-config\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-netns\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.787761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ddddc73-e38f-48b8-ac72-ece19246ba96-tmp-dir\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/377177fc-ec9e-493e-8f6d-7ec009fd59a8-iptables-alerter-script\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787538 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/377177fc-ec9e-493e-8f6d-7ec009fd59a8-host-slash\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787562 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-var-lib-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.787576 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-kubelet\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/609720d4-d6e9-4331-a538-74d1ac2b7d73-tmp\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.787653 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:36.287613111 +0000 UTC m=+2.097585779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/340a413f-7c23-4de1-9aaf-bf0efacbd63d-konnectivity-ca\") pod \"konnectivity-agent-hxz5z\" (UID: \"340a413f-7c23-4de1-9aaf-bf0efacbd63d\") " pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-os-release\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-cni-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8l4\" (UniqueName: \"kubernetes.io/projected/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-kube-api-access-5k8l4\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787803 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-kubernetes\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/377177fc-ec9e-493e-8f6d-7ec009fd59a8-host-slash\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787816 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787829 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-ovnkube-script-lib\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.788622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysctl-conf\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787856 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-var-lib-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-run\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787893 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-kubelet\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787834 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrl8\" (UniqueName: \"kubernetes.io/projected/f7207946-297b-4717-9bc1-f8881a1fe3de-kube-api-access-wxrl8\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787946 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-kubernetes\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ddddc73-e38f-48b8-ac72-ece19246ba96-hosts-file\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787984 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-run\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-run-netns\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-daemon-config\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-run-ovn-kubernetes\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-run-netns\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788059 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/377177fc-ec9e-493e-8f6d-7ec009fd59a8-iptables-alerter-script\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788067 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-run-ovn-kubernetes\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788068 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9s5x\" (UniqueName: \"kubernetes.io/projected/c0985ac6-dfbb-4351-a385-948cf5f06462-kube-api-access-b9s5x\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-os-release\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-socket-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.789514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jccz\" (UniqueName: \"kubernetes.io/projected/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-kube-api-access-5jccz\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.787945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-cni-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-multus-certs\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysctl-conf\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-modprobe-d\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-systemd\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788281 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/340a413f-7c23-4de1-9aaf-bf0efacbd63d-agent-certs\") pod \"konnectivity-agent-hxz5z\" (UID: \"340a413f-7c23-4de1-9aaf-bf0efacbd63d\") " pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788307 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-modprobe-d\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-log-socket\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-run-multus-certs\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788381 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788410 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysctl-d\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-socket-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-slash\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-node-log\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788469 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-systemd\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788136 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ddddc73-e38f-48b8-ac72-ece19246ba96-hosts-file\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-ovnkube-config\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-conf-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.788533 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.788585 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:36.288567794 +0000 UTC m=+2.098540452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-477lc\" (UniqueName: \"kubernetes.io/projected/6ddddc73-e38f-48b8-ac72-ece19246ba96-kube-api-access-477lc\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63212e1d-8ecf-438b-ba7c-00dd6809dec4-dbus\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-log-socket\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-host\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-tuned\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788693 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/340a413f-7c23-4de1-9aaf-bf0efacbd63d-konnectivity-ca\") pod \"konnectivity-agent-hxz5z\" (UID: \"340a413f-7c23-4de1-9aaf-bf0efacbd63d\") " pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pdb\" (UniqueName: \"kubernetes.io/projected/609720d4-d6e9-4331-a538-74d1ac2b7d73-kube-api-access-c9pdb\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-etc-selinux\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-slash\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-ovn\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.790860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-os-release\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-device-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysctl-d\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-sys-fs\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-systemd\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63212e1d-8ecf-438b-ba7c-00dd6809dec4-dbus\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-ovnkube-config\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-cni-binary-copy\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788950 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-host\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-socket-dir-parent\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-node-log\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-cni-multus\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-socket-dir-parent\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-ovn\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpbb4\" (UniqueName: \"kubernetes.io/projected/806644ce-16a7-4599-be11-4bf2634a2bd5-kube-api-access-zpbb4\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.791379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-sys-fs\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-system-cni-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-hostroot\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789131 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-cni-multus\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysconfig\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-sys\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-device-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-lib-modules\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789259 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-system-cni-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789327 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-etc-selinux\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-lib-modules\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.788726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-multus-conf-dir\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-cni-binary-copy\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-openvswitch\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-run-systemd\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789457 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-os-release\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7207946-297b-4717-9bc1-f8881a1fe3de-serviceca\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.791834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789489 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-hostroot\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-sysconfig\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789512 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/609720d4-d6e9-4331-a538-74d1ac2b7d73-sys\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-registration-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-systemd-units\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-env-overrides\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-cnibin\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789620 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-registration-dir\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-cni-bin\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0985ac6-dfbb-4351-a385-948cf5f06462-systemd-units\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkmv\" (UniqueName: \"kubernetes.io/projected/377177fc-ec9e-493e-8f6d-7ec009fd59a8-kube-api-access-hqkmv\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789693 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-cnibin\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqw\" (UniqueName: \"kubernetes.io/projected/93bc553b-de82-4307-93d9-b909bcbe2069-kube-api-access-bskqw\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789819 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/806644ce-16a7-4599-be11-4bf2634a2bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789852 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7207946-297b-4717-9bc1-f8881a1fe3de-serviceca\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.792370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.789995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0985ac6-dfbb-4351-a385-948cf5f06462-env-overrides\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.792819 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.790023 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-host-var-lib-cni-bin\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.792819 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.790081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/806644ce-16a7-4599-be11-4bf2634a2bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.792819 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.791127 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/609720d4-d6e9-4331-a538-74d1ac2b7d73-tmp\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.792819 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.791199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0985ac6-dfbb-4351-a385-948cf5f06462-ovn-node-metrics-cert\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.792819 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.791209 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/340a413f-7c23-4de1-9aaf-bf0efacbd63d-agent-certs\") pod \"konnectivity-agent-hxz5z\" (UID: \"340a413f-7c23-4de1-9aaf-bf0efacbd63d\") " pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:35.792819 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.791545 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/609720d4-d6e9-4331-a538-74d1ac2b7d73-etc-tuned\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.799043 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.799020 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jccz\" (UniqueName: \"kubernetes.io/projected/2c32dda3-e1ca-49b1-ad7a-3d33305ed29f-kube-api-access-5jccz\") pod \"aws-ebs-csi-driver-node-kct7g\" (UID: \"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:35.799668 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.799649 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8l4\" (UniqueName: \"kubernetes.io/projected/7e0ffef5-efc3-4f9b-9d71-629b0395a53b-kube-api-access-5k8l4\") pod \"multus-8j6jw\" (UID: \"7e0ffef5-efc3-4f9b-9d71-629b0395a53b\") " pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.799734 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.799716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrl8\" (UniqueName: \"kubernetes.io/projected/f7207946-297b-4717-9bc1-f8881a1fe3de-kube-api-access-wxrl8\") pod \"node-ca-m982k\" (UID: \"f7207946-297b-4717-9bc1-f8881a1fe3de\") " pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.800218 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.800203 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:35.800297 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.800220 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:35.800297 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.800229 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:35.800297 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:35.800288 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:36.30027686 +0000 UTC m=+2.110249505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:35.801730 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.801712 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9s5x\" (UniqueName: \"kubernetes.io/projected/c0985ac6-dfbb-4351-a385-948cf5f06462-kube-api-access-b9s5x\") pod \"ovnkube-node-ccnvt\" (UID: \"c0985ac6-dfbb-4351-a385-948cf5f06462\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.802070 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.802052 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-477lc\" (UniqueName: \"kubernetes.io/projected/6ddddc73-e38f-48b8-ac72-ece19246ba96-kube-api-access-477lc\") pod \"node-resolver-b7lgq\" (UID: \"6ddddc73-e38f-48b8-ac72-ece19246ba96\") " pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.802501 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.802483 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpbb4\" (UniqueName: \"kubernetes.io/projected/806644ce-16a7-4599-be11-4bf2634a2bd5-kube-api-access-zpbb4\") pod \"multus-additional-cni-plugins-kcrjt\" (UID: \"806644ce-16a7-4599-be11-4bf2634a2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.802865 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.802851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskqw\" (UniqueName: \"kubernetes.io/projected/93bc553b-de82-4307-93d9-b909bcbe2069-kube-api-access-bskqw\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:35.803291 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.803272 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pdb\" (UniqueName: \"kubernetes.io/projected/609720d4-d6e9-4331-a538-74d1ac2b7d73-kube-api-access-c9pdb\") pod \"tuned-vngrj\" (UID: \"609720d4-d6e9-4331-a538-74d1ac2b7d73\") " pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.803371 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.803235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkmv\" (UniqueName: \"kubernetes.io/projected/377177fc-ec9e-493e-8f6d-7ec009fd59a8-kube-api-access-hqkmv\") pod \"iptables-alerter-62lwn\" (UID: \"377177fc-ec9e-493e-8f6d-7ec009fd59a8\") " pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:35.907826 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.907802 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:24:35.916150 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.916130 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0985ac6_dfbb_4351_a385_948cf5f06462.slice/crio-e13ab8fd17c7bf2f6c38ea4644e99038f4b6d95015bffb8abe0056a9fb43f134 WatchSource:0}: Error finding container e13ab8fd17c7bf2f6c38ea4644e99038f4b6d95015bffb8abe0056a9fb43f134: Status 404 returned error can't find the container with id e13ab8fd17c7bf2f6c38ea4644e99038f4b6d95015bffb8abe0056a9fb43f134 Jun 13 05:24:35.931319 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.931301 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b7lgq" Jun 13 05:24:35.937895 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.937878 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ddddc73_e38f_48b8_ac72_ece19246ba96.slice/crio-9d618f6cc8a0af7d8bdb8b42ca50eaef88174cc84ece966f972f78f95f3a701d WatchSource:0}: Error finding container 9d618f6cc8a0af7d8bdb8b42ca50eaef88174cc84ece966f972f78f95f3a701d: Status 404 returned error can't find the container with id 9d618f6cc8a0af7d8bdb8b42ca50eaef88174cc84ece966f972f78f95f3a701d Jun 13 05:24:35.941868 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.941852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vngrj" Jun 13 05:24:35.948560 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.948538 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609720d4_d6e9_4331_a538_74d1ac2b7d73.slice/crio-18d5726fd74f55be204d7c9f0b540b9df1884380d1cbaad436a328e78904cb3d WatchSource:0}: Error finding container 18d5726fd74f55be204d7c9f0b540b9df1884380d1cbaad436a328e78904cb3d: Status 404 returned error can't find the container with id 18d5726fd74f55be204d7c9f0b540b9df1884380d1cbaad436a328e78904cb3d Jun 13 05:24:35.956838 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.956821 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m982k" Jun 13 05:24:35.961758 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.961741 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8j6jw" Jun 13 05:24:35.963359 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.963327 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7207946_297b_4717_9bc1_f8881a1fe3de.slice/crio-1e8b3255e8185898f6766eb0b4d2eb279521b429236a66118640599103b06252 WatchSource:0}: Error finding container 1e8b3255e8185898f6766eb0b4d2eb279521b429236a66118640599103b06252: Status 404 returned error can't find the container with id 1e8b3255e8185898f6766eb0b4d2eb279521b429236a66118640599103b06252 Jun 13 05:24:35.969780 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.969762 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0ffef5_efc3_4f9b_9d71_629b0395a53b.slice/crio-0a628cee4d97e4ce70e47c5d03e8ec7d239e0e6815d24eff7bd1dd2b87d074c1 WatchSource:0}: Error finding container 0a628cee4d97e4ce70e47c5d03e8ec7d239e0e6815d24eff7bd1dd2b87d074c1: Status 404 returned error can't find the container with id 0a628cee4d97e4ce70e47c5d03e8ec7d239e0e6815d24eff7bd1dd2b87d074c1 Jun 13 05:24:35.980289 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.980273 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" Jun 13 05:24:35.986777 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:35.986761 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806644ce_16a7_4599_be11_4bf2634a2bd5.slice/crio-63d2231e66ecbb4ee670c3af2ff8cd5ff506f0200d8211b4e6228418f3924fa6 WatchSource:0}: Error finding container 63d2231e66ecbb4ee670c3af2ff8cd5ff506f0200d8211b4e6228418f3924fa6: Status 404 returned error can't find the container with id 63d2231e66ecbb4ee670c3af2ff8cd5ff506f0200d8211b4e6228418f3924fa6 Jun 13 05:24:35.999536 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:35.999520 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:36.005878 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:36.005856 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340a413f_7c23_4de1_9aaf_bf0efacbd63d.slice/crio-060ff72a3d00a60fdf639866a528fb857997ca860bea4bbed45d940fd1963e91 WatchSource:0}: Error finding container 060ff72a3d00a60fdf639866a528fb857997ca860bea4bbed45d940fd1963e91: Status 404 returned error can't find the container with id 060ff72a3d00a60fdf639866a528fb857997ca860bea4bbed45d940fd1963e91 Jun 13 05:24:36.009672 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.009656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" Jun 13 05:24:36.013635 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.013613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-62lwn" Jun 13 05:24:36.015836 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:36.015818 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c32dda3_e1ca_49b1_ad7a_3d33305ed29f.slice/crio-2a88e581825145f310ed2aa39f1ff0b6fd3b386549678cb94b6c5448e2f16610 WatchSource:0}: Error finding container 2a88e581825145f310ed2aa39f1ff0b6fd3b386549678cb94b6c5448e2f16610: Status 404 returned error can't find the container with id 2a88e581825145f310ed2aa39f1ff0b6fd3b386549678cb94b6c5448e2f16610 Jun 13 05:24:36.020600 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:24:36.020580 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377177fc_ec9e_493e_8f6d_7ec009fd59a8.slice/crio-125cd6d8514d9a9513f5ac416bcfadc7e65d9e7896ab07bea582a64f3d787368 WatchSource:0}: Error finding container 125cd6d8514d9a9513f5ac416bcfadc7e65d9e7896ab07bea582a64f3d787368: Status 404 returned error can't find the container with id 125cd6d8514d9a9513f5ac416bcfadc7e65d9e7896ab07bea582a64f3d787368 Jun 13 05:24:36.294197 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.294165 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:36.294386 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.294222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:36.294386 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.294350 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:36.294488 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.294408 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:37.294388393 +0000 UTC m=+3.104361045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:36.294810 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.294791 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:36.294893 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.294841 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:37.29482452 +0000 UTC m=+3.104797170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:36.381695 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.381667 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:36.395182 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.395156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:36.395725 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.395346 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:36.395725 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.395371 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:36.395725 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.395384 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:36.395725 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:36.395438 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:37.39542109 +0000 UTC m=+3.205393736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:36.622852 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.622734 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 05:19:35 +0000 UTC" deadline="2027-12-22 07:41:19.54564183 +0000 UTC" Jun 13 05:24:36.622852 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.622788 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13370h16m42.922857112s" Jun 13 05:24:36.661754 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.661699 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-62lwn" event={"ID":"377177fc-ec9e-493e-8f6d-7ec009fd59a8","Type":"ContainerStarted","Data":"125cd6d8514d9a9513f5ac416bcfadc7e65d9e7896ab07bea582a64f3d787368"} Jun 13 05:24:36.673199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.673129 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8j6jw" event={"ID":"7e0ffef5-efc3-4f9b-9d71-629b0395a53b","Type":"ContainerStarted","Data":"0a628cee4d97e4ce70e47c5d03e8ec7d239e0e6815d24eff7bd1dd2b87d074c1"} Jun 13 05:24:36.680258 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.680216 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m982k" event={"ID":"f7207946-297b-4717-9bc1-f8881a1fe3de","Type":"ContainerStarted","Data":"1e8b3255e8185898f6766eb0b4d2eb279521b429236a66118640599103b06252"} Jun 13 05:24:36.700172 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.700141 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vngrj" event={"ID":"609720d4-d6e9-4331-a538-74d1ac2b7d73","Type":"ContainerStarted","Data":"18d5726fd74f55be204d7c9f0b540b9df1884380d1cbaad436a328e78904cb3d"} Jun 13 05:24:36.708828 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.708802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b7lgq" event={"ID":"6ddddc73-e38f-48b8-ac72-ece19246ba96","Type":"ContainerStarted","Data":"9d618f6cc8a0af7d8bdb8b42ca50eaef88174cc84ece966f972f78f95f3a701d"} Jun 13 05:24:36.717959 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.717937 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:36.726997 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.726968 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" event={"ID":"1fe66e8e3119d6c8dde4b22554a082ea","Type":"ContainerStarted","Data":"3b7544655e3c3cb60d2ab3ef388d81c881d7afe7f941c255d7ef7bc291d635c7"} Jun 13 05:24:36.741949 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.741922 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" event={"ID":"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f","Type":"ContainerStarted","Data":"2a88e581825145f310ed2aa39f1ff0b6fd3b386549678cb94b6c5448e2f16610"} Jun 13 05:24:36.760407 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.760379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxz5z" event={"ID":"340a413f-7c23-4de1-9aaf-bf0efacbd63d","Type":"ContainerStarted","Data":"060ff72a3d00a60fdf639866a528fb857997ca860bea4bbed45d940fd1963e91"} Jun 13 05:24:36.773606 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.773580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerStarted","Data":"63d2231e66ecbb4ee670c3af2ff8cd5ff506f0200d8211b4e6228418f3924fa6"} Jun 13 05:24:36.789675 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.789648 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"e13ab8fd17c7bf2f6c38ea4644e99038f4b6d95015bffb8abe0056a9fb43f134"} Jun 13 05:24:36.808893 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:36.808868 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" event={"ID":"325dc2cb6d43f6fe0a18472a3561b341","Type":"ContainerStarted","Data":"8f69e82a3c43c61ebb5131947498e76fc937eb213b5547d24caf447e1a091ac1"} Jun 13 05:24:37.304358 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.304321 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:37.304358 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.304384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:37.304635 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.304508 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:37.304635 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.304571 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:39.304550344 +0000 UTC m=+5.114523004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:37.304973 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.304950 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:37.305031 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.305007 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:39.304992773 +0000 UTC m=+5.114965435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:37.405332 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.405287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:37.405508 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.405448 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:37.405508 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.405466 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:37.405508 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.405478 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:37.405675 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.405577 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:39.405520647 +0000 UTC m=+5.215493293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:37.623974 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.623890 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 05:19:35 +0000 UTC" deadline="2027-11-10 09:17:43.334939468 +0000 UTC" Jun 13 05:24:37.623974 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.623930 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12363h53m5.711015565s" Jun 13 05:24:37.643429 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.643379 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:37.643623 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.643501 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:37.643906 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.643884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:37.644016 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.643994 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:37.644070 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.644053 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:37.644152 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:37.644117 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:37.693876 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.693725 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:37.997030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:37.996947 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:39.319135 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:39.319093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:39.319591 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:39.319167 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:39.319591 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.319353 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:39.319591 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.319420 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:43.319398311 +0000 UTC m=+9.129370959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:39.319855 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.319836 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:39.319917 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.319894 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:43.319878961 +0000 UTC m=+9.129851611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:39.420186 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:39.420105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:39.420372 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.420354 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:39.420431 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.420382 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:39.420431 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.420397 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:39.420533 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.420446 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:43.420433822 +0000 UTC m=+9.230406467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:39.643295 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:39.643263 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:39.643470 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.643391 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:39.643470 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:39.643465 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:39.643579 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.643549 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:39.643635 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:39.643600 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:39.643689 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:39.643669 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:41.643742 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:41.643709 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:41.644216 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:41.643834 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:41.644216 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:41.643904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:41.644216 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:41.644026 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:41.644216 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:41.644088 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:41.644216 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:41.644162 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:43.350993 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:43.350679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:43.350993 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:43.350748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:43.350993 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.350818 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:43.350993 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.350877 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:43.350993 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.350880 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:51.350861707 +0000 UTC m=+17.160834361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:43.350993 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.350975 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:51.350963377 +0000 UTC m=+17.160936023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:43.451735 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:43.451701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:43.451908 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.451863 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:43.451908 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.451883 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:43.451908 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.451895 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:43.452069 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.451944 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:51.451930259 +0000 UTC m=+17.261902914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:43.644978 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:43.644007 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:43.644978 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.644166 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:43.644978 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:43.644620 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:43.644978 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.644712 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:43.644978 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:43.644789 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:43.644978 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:43.644863 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:45.643136 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:45.643097 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:45.643136 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:45.643126 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:45.643136 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:45.643097 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:45.643920 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:45.643231 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:45.643920 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:45.643363 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:45.643920 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:45.643473 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:47.644006 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:47.643971 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:47.644006 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:47.644000 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:47.644516 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:47.644016 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:47.644516 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:47.644108 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:47.644516 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:47.644212 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:47.644516 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:47.644340 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:49.644107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:49.644076 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:49.644566 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:49.644189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:49.644566 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:49.644199 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:49.644566 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:49.644226 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:49.644566 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:49.644341 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:49.644566 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:49.644446 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:51.411718 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:51.411681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:51.412122 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:51.411731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:51.412122 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.411822 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:51.412122 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.411836 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:51.412122 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.411873 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:07.411859868 +0000 UTC m=+33.221832513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:51.412122 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.411899 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:07.41188056 +0000 UTC m=+33.221853225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:51.512719 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:51.512678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:51.512883 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.512823 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:51.512883 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.512845 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:51.512883 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.512859 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:51.513025 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.512958 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:07.512940927 +0000 UTC m=+33.322913577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:51.643149 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:51.643112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:51.643333 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:51.643112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:51.643333 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:51.643113 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:51.643333 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.643296 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:51.643500 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.643364 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:51.643500 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:51.643454 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:53.643159 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:53.643123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:53.643159 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:53.643161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:53.643622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:53.643161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:53.643622 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:53.643237 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:53.643622 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:53.643354 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:53.643622 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:53.643437 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:55.643459 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.643398 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:55.643748 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:55.643487 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:55.643748 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.643506 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:55.643748 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.643409 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:55.643748 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:55.643586 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:55.643748 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:55.643642 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:55.855053 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.854944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" event={"ID":"325dc2cb6d43f6fe0a18472a3561b341","Type":"ContainerStarted","Data":"5b402f04a743b8bc72509f0e48d2bf4a4de689640da598e9aada95a5fe4982e9"} Jun 13 05:24:55.857627 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.857368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8j6jw" event={"ID":"7e0ffef5-efc3-4f9b-9d71-629b0395a53b","Type":"ContainerStarted","Data":"6b5326287496a9f662760277da872b07f6e59b6ee0e03276bb23a8dd5aaa0e96"} Jun 13 05:24:55.859301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.859275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vngrj" event={"ID":"609720d4-d6e9-4331-a538-74d1ac2b7d73","Type":"ContainerStarted","Data":"74c9b363bd523e0dcb2e3e8e6559e0dff26596a28648566f3c83c8a781a42651"} Jun 13 05:24:55.868022 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.867970 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-198.ec2.internal" podStartSLOduration=20.867956957 podStartE2EDuration="20.867956957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:55.86739129 +0000 UTC m=+21.677363957" watchObservedRunningTime="2026-06-13 05:24:55.867956957 +0000 UTC m=+21.677929623" Jun 13 05:24:55.883449 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.883413 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vngrj" podStartSLOduration=2.516920073 podStartE2EDuration="21.88339898s" totalImagesPullingTime="19.366478907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:55.88228126 +0000 UTC m=+21.692253939" watchObservedRunningTime="2026-06-13 05:24:55.88339898 +0000 UTC m=+21.693371687" Jun 13 05:24:55.897454 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:55.897410 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8j6jw" podStartSLOduration=2.546964766 podStartE2EDuration="21.897398319s" totalImagesPullingTime="19.350433553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:55.897366065 +0000 UTC m=+21.707338753" watchObservedRunningTime="2026-06-13 05:24:55.897398319 +0000 UTC m=+21.707370986" Jun 13 05:24:56.862720 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.862682 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxz5z" event={"ID":"340a413f-7c23-4de1-9aaf-bf0efacbd63d","Type":"ContainerStarted","Data":"91a6f76412d903e5df30e01cfb215116b4f295e7de1997bddee4d2376c3f2ad3"} Jun 13 05:24:56.864127 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.864104 2566 generic.go:356] "Generic (PLEG): container finished" podID="806644ce-16a7-4599-be11-4bf2634a2bd5" containerID="14a0680db110f49191d596624e700ef9221251ef4168a231762e59cfa7c8802d" exitCode=0 Jun 13 05:24:56.864226 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.864171 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerDied","Data":"14a0680db110f49191d596624e700ef9221251ef4168a231762e59cfa7c8802d"} Jun 13 05:24:56.867076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867058 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:24:56.867417 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867400 2566 generic.go:356] "Generic (PLEG): container finished" podID="c0985ac6-dfbb-4351-a385-948cf5f06462" containerID="3488540e26a3d46bc3d8cfca694c91603b8edd2d2e979d8d8e80b17fdf3f6084" exitCode=1 Jun 13 05:24:56.867505 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"b7a2d607338115671e29fd5a5546b6e891ffc54299974a4306a966fb7b96935e"} Jun 13 05:24:56.867567 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"d1393429e27e1c8f04f7a1e3e3c09db8c1b8d8730d195e5eec0ec46273fdd682"} Jun 13 05:24:56.867632 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867591 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"f0dbb2fa6c8caa716c84382e7b6e60407d267b230e88438efd4b18723f6076b5"} Jun 13 05:24:56.867688 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867638 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"60f693c3e8c176ebe8714db31ce560a4bad22543ed058afa1df05f10e1c022c9"} Jun 13 05:24:56.867741 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerDied","Data":"3488540e26a3d46bc3d8cfca694c91603b8edd2d2e979d8d8e80b17fdf3f6084"} Jun 13 05:24:56.867794 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.867738 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"39deef4e9109fbee09663336739541015d21e85be94ad75665f256050c93c66e"} Jun 13 05:24:56.868754 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.868724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-62lwn" event={"ID":"377177fc-ec9e-493e-8f6d-7ec009fd59a8","Type":"ContainerStarted","Data":"f6e4cfd93eaa4c961e5a29c66bf68759fb3e3946da9ad65f7817bdabe17ddd4a"} Jun 13 05:24:56.869997 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.869967 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m982k" event={"ID":"f7207946-297b-4717-9bc1-f8881a1fe3de","Type":"ContainerStarted","Data":"9a6cd1ebf4062b64eaac92c6daa51693f996ff38c30cd07e0abe87efc2091b88"} Jun 13 05:24:56.871677 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.871658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b7lgq" event={"ID":"6ddddc73-e38f-48b8-ac72-ece19246ba96","Type":"ContainerStarted","Data":"ce1fc8ecd4c83dc86fe936af7e010355810884f4d267d5993a3cdb9079767f89"} Jun 13 05:24:56.872905 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.872882 2566 generic.go:356] "Generic (PLEG): container finished" podID="1fe66e8e3119d6c8dde4b22554a082ea" containerID="f23dcf43a5e70fda6dce1234f3ac09c9c56cf274cae004824cd8436cb4e60fcd" exitCode=0 Jun 13 05:24:56.872989 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.872957 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" event={"ID":"1fe66e8e3119d6c8dde4b22554a082ea","Type":"ContainerDied","Data":"f23dcf43a5e70fda6dce1234f3ac09c9c56cf274cae004824cd8436cb4e60fcd"} Jun 13 05:24:56.874226 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.874204 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" event={"ID":"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f","Type":"ContainerStarted","Data":"5e700b2c24ca0299c6043fba0e76851e63ecc6a4ec4fda60dae78f9e0c41cf02"} Jun 13 05:24:56.876137 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.876104 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxz5z" podStartSLOduration=3.624307727 podStartE2EDuration="22.876094102s" totalImagesPullingTime="19.251786375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:56.875752287 +0000 UTC m=+22.685724946" watchObservedRunningTime="2026-06-13 05:24:56.876094102 +0000 UTC m=+22.686066768" Jun 13 05:24:56.888149 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.888118 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m982k" podStartSLOduration=3.568750497 podStartE2EDuration="22.888106486s" totalImagesPullingTime="19.319355989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:56.887911594 +0000 UTC m=+22.697884259" watchObservedRunningTime="2026-06-13 05:24:56.888106486 +0000 UTC m=+22.698079153" Jun 13 05:24:56.919782 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.919704 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-62lwn" podStartSLOduration=3.623867884 podStartE2EDuration="22.91968863s" totalImagesPullingTime="19.295820746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:56.919673966 +0000 UTC m=+22.729646633" watchObservedRunningTime="2026-06-13 05:24:56.91968863 +0000 UTC m=+22.729661315" Jun 13 05:24:56.932675 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:56.932640 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b7lgq" podStartSLOduration=3.587170644 podStartE2EDuration="22.932628221s" totalImagesPullingTime="19.345457577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:56.932613448 +0000 UTC m=+22.742586115" watchObservedRunningTime="2026-06-13 05:24:56.932628221 +0000 UTC m=+22.742600890" Jun 13 05:24:57.644319 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.644056 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:57.644553 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.644104 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:57.644553 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:57.644414 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:57.644553 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.644113 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:57.644553 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:57.644504 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:57.644767 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:57.644561 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:57.813107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.813082 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 05:24:57.836903 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.836877 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:57.837328 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.837315 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:24:57.878946 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.878920 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" event={"ID":"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f","Type":"ContainerStarted","Data":"55639adbee7386363c245d1adbbcb0b56ed53bc14de40cd1afcc549be39df838"} Jun 13 05:24:57.880883 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.880858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" event={"ID":"1fe66e8e3119d6c8dde4b22554a082ea","Type":"ContainerStarted","Data":"912b638e8198692517c8f6673a9e2f43de8533766221de6f5b3e9a41dfff8b95"} Jun 13 05:24:57.894901 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:57.894841 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-198.ec2.internal" podStartSLOduration=22.894828547 podStartE2EDuration="22.894828547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:57.89476825 +0000 UTC m=+23.704740936" watchObservedRunningTime="2026-06-13 05:24:57.894828547 +0000 UTC m=+23.704801212" Jun 13 05:24:58.638689 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:58.638585 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T05:24:57.813102885Z","UUID":"a5486bb3-b8d3-4c18-ad34-29d2c68e27e7","Handler":null,"Name":"","Endpoint":""} Jun 13 05:24:58.640446 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:58.640422 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 05:24:58.640556 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:58.640468 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 05:24:58.886100 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:58.886078 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:24:58.886607 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:58.886453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"dabe59611161329d0eb85458dafa187332d6caa78f02fbb0f80ce6d88a8e19f1"} Jun 13 05:24:58.886607 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:58.886493 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 05:24:59.643511 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:59.643482 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:24:59.643511 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:59.643516 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:24:59.643732 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:59.643483 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:24:59.643732 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:59.643616 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:24:59.643732 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:59.643693 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:24:59.643851 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:24:59.643768 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:24:59.891107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:59.891074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" event={"ID":"2c32dda3-e1ca-49b1-ad7a-3d33305ed29f","Type":"ContainerStarted","Data":"faab3d097e127bd3bbb6d041b48cb29257498383a985c4183c9e3aec7a4edc94"} Jun 13 05:24:59.907737 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:24:59.907646 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kct7g" podStartSLOduration=4.512629996 podStartE2EDuration="25.907632334s" totalImagesPullingTime="21.395002338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:59.90720835 +0000 UTC m=+25.717181020" watchObservedRunningTime="2026-06-13 05:24:59.907632334 +0000 UTC m=+25.717605002" Jun 13 05:25:01.644188 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.644004 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:01.644548 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.644004 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:01.644548 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:01.644272 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:25:01.644548 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.644004 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:01.644548 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:01.644340 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:25:01.644548 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:01.644394 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:25:01.898995 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.898930 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:25:01.899328 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.899302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"499cfd16d00b0af395eb1db59def6eba9dbd5980146427dde8fa0d1d31069b59"} Jun 13 05:25:01.899800 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.899755 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:25:01.899939 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.899846 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:25:01.899939 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.899897 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:25:01.899939 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.899915 2566 scope.go:117] "RemoveContainer" containerID="3488540e26a3d46bc3d8cfca694c91603b8edd2d2e979d8d8e80b17fdf3f6084" Jun 13 05:25:01.916373 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.916350 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:25:01.916968 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:01.916945 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:25:02.903097 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:02.903061 2566 generic.go:356] "Generic (PLEG): container finished" podID="806644ce-16a7-4599-be11-4bf2634a2bd5" containerID="a9ba30500838b7b75d024893e5f016be5c4a2d360bca820b2b25ca5667c145e4" exitCode=0 Jun 13 05:25:02.903546 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:02.903150 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerDied","Data":"a9ba30500838b7b75d024893e5f016be5c4a2d360bca820b2b25ca5667c145e4"} Jun 13 05:25:02.906895 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:02.906876 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:25:02.907260 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:02.907230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" event={"ID":"c0985ac6-dfbb-4351-a385-948cf5f06462","Type":"ContainerStarted","Data":"520764f1cadf7111af7323bffcccad15c67ffdd4f3c6f6331f5e4410e7c08bfe"} Jun 13 05:25:02.947382 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:02.947279 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" podStartSLOduration=8.997341918 podStartE2EDuration="28.947262545s" totalImagesPullingTime="19.949920627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:02.946778852 +0000 UTC m=+28.756751545" watchObservedRunningTime="2026-06-13 05:25:02.947262545 +0000 UTC m=+28.757235221" Jun 13 05:25:03.643980 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.643946 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:03.644140 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.643946 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:03.644140 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.644080 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:03.644140 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:03.644076 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:25:03.644328 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:03.644217 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:25:03.644328 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:03.644316 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:25:03.693002 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.692976 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2bpsg"] Jun 13 05:25:03.697989 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.697964 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ws94t"] Jun 13 05:25:03.698564 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.698545 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvpgj"] Jun 13 05:25:03.913608 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.913586 2566 generic.go:356] "Generic (PLEG): container finished" podID="806644ce-16a7-4599-be11-4bf2634a2bd5" containerID="9e0578cdd10c206be965bea67be018c97774279e7013abba9b769ba73c61790a" exitCode=0 Jun 13 05:25:03.914060 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.913683 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerDied","Data":"9e0578cdd10c206be965bea67be018c97774279e7013abba9b769ba73c61790a"} Jun 13 05:25:03.914060 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.913695 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:03.914161 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.914146 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:03.914539 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:03.914255 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:25:03.914539 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:03.914286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:03.914539 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:03.914358 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:25:03.914539 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:03.914446 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:25:04.922260 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:04.922219 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerStarted","Data":"41298993b1fd981c01807fe3e903e856f4a0c789487cafddf5f2bfd5a6805173"} Jun 13 05:25:05.188312 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.188230 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:25:05.188459 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.188355 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 05:25:05.189110 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.189094 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxz5z" Jun 13 05:25:05.643596 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.643563 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:05.643743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.643654 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:05.643743 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:05.643665 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:25:05.643743 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.643682 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:05.643841 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:05.643767 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:25:05.643875 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:05.643836 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:25:05.926933 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.926646 2566 generic.go:356] "Generic (PLEG): container finished" podID="806644ce-16a7-4599-be11-4bf2634a2bd5" containerID="41298993b1fd981c01807fe3e903e856f4a0c789487cafddf5f2bfd5a6805173" exitCode=0 Jun 13 05:25:05.927299 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:05.926736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerDied","Data":"41298993b1fd981c01807fe3e903e856f4a0c789487cafddf5f2bfd5a6805173"} Jun 13 05:25:07.440560 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:07.440521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:07.441086 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:07.440681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:07.441086 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.440684 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:25:07.441086 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.440734 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:25:07.441086 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.440779 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:39.44075794 +0000 UTC m=+65.250730588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:25:07.441086 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.440798 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret podName:63212e1d-8ecf-438b-ba7c-00dd6809dec4 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:39.440788797 +0000 UTC m=+65.250761448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret") pod "global-pull-secret-syncer-2bpsg" (UID: "63212e1d-8ecf-438b-ba7c-00dd6809dec4") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:25:07.541462 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:07.541431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:07.541639 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.541568 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:25:07.541639 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.541585 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:25:07.541639 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.541599 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gqvnf for pod openshift-network-diagnostics/network-check-target-ws94t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:25:07.541843 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.541651 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf podName:691a24b0-b545-4206-b229-06b3972e0908 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:39.541635364 +0000 UTC m=+65.351608031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqvnf" (UniqueName: "kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf") pod "network-check-target-ws94t" (UID: "691a24b0-b545-4206-b229-06b3972e0908") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:25:07.643337 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:07.643304 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:07.643502 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:07.643313 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:07.643502 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.643448 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:25:07.643502 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.643492 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ws94t" podUID="691a24b0-b545-4206-b229-06b3972e0908" Jun 13 05:25:07.643859 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:07.643838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:07.643964 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:07.643948 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2bpsg" podUID="63212e1d-8ecf-438b-ba7c-00dd6809dec4" Jun 13 05:25:08.517682 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.517605 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-198.ec2.internal" event="NodeReady" Jun 13 05:25:08.518071 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.517743 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 05:25:08.559155 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.559129 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qt2dt"] Jun 13 05:25:08.560857 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.560835 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.561932 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.561907 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nx8cq"] Jun 13 05:25:08.563294 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.563274 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 05:25:08.563400 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.563312 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 05:25:08.563400 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.563317 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-24sgs\"" Jun 13 05:25:08.563519 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.563503 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.565629 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.565613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hg2sl\"" Jun 13 05:25:08.565815 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.565803 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 05:25:08.565855 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.565832 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 05:25:08.566105 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.566092 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 05:25:08.571586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.571567 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qt2dt"] Jun 13 05:25:08.574887 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.574859 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nx8cq"] Jun 13 05:25:08.650114 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.650089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsj6z\" (UniqueName: \"kubernetes.io/projected/456a212c-6a21-4304-ae5a-9343986e6cd8-kube-api-access-fsj6z\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.650274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.650126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b4b7f8-1c30-4340-a45d-35d98cbd576a-cert\") pod \"ingress-canary-nx8cq\" (UID: \"46b4b7f8-1c30-4340-a45d-35d98cbd576a\") " pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.650274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.650149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456a212c-6a21-4304-ae5a-9343986e6cd8-tmp-dir\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.650274 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.650229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.650436 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.650281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/456a212c-6a21-4304-ae5a-9343986e6cd8-config-volume\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.650436 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.650301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjq8t\" (UniqueName: \"kubernetes.io/projected/46b4b7f8-1c30-4340-a45d-35d98cbd576a-kube-api-access-qjq8t\") pod \"ingress-canary-nx8cq\" (UID: \"46b4b7f8-1c30-4340-a45d-35d98cbd576a\") " pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.751529 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b4b7f8-1c30-4340-a45d-35d98cbd576a-cert\") pod \"ingress-canary-nx8cq\" (UID: \"46b4b7f8-1c30-4340-a45d-35d98cbd576a\") " pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.751692 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456a212c-6a21-4304-ae5a-9343986e6cd8-tmp-dir\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.751692 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.751692 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/456a212c-6a21-4304-ae5a-9343986e6cd8-config-volume\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.751692 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjq8t\" (UniqueName: \"kubernetes.io/projected/46b4b7f8-1c30-4340-a45d-35d98cbd576a-kube-api-access-qjq8t\") pod \"ingress-canary-nx8cq\" (UID: \"46b4b7f8-1c30-4340-a45d-35d98cbd576a\") " pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.751692 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsj6z\" (UniqueName: \"kubernetes.io/projected/456a212c-6a21-4304-ae5a-9343986e6cd8-kube-api-access-fsj6z\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.751965 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:08.751717 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:08.751965 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:08.751778 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:09.251758136 +0000 UTC m=+35.061730793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:08.751965 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.751923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456a212c-6a21-4304-ae5a-9343986e6cd8-tmp-dir\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.752456 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.752427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/456a212c-6a21-4304-ae5a-9343986e6cd8-config-volume\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.756470 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.756450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b4b7f8-1c30-4340-a45d-35d98cbd576a-cert\") pod \"ingress-canary-nx8cq\" (UID: \"46b4b7f8-1c30-4340-a45d-35d98cbd576a\") " pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.764000 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.763973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsj6z\" (UniqueName: \"kubernetes.io/projected/456a212c-6a21-4304-ae5a-9343986e6cd8-kube-api-access-fsj6z\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:08.764101 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.764077 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjq8t\" (UniqueName: \"kubernetes.io/projected/46b4b7f8-1c30-4340-a45d-35d98cbd576a-kube-api-access-qjq8t\") pod \"ingress-canary-nx8cq\" (UID: \"46b4b7f8-1c30-4340-a45d-35d98cbd576a\") " pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:08.877476 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:08.877442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nx8cq" Jun 13 05:25:09.255502 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.255412 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:09.255669 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:09.255566 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:09.255669 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:09.255631 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:10.255612349 +0000 UTC m=+36.065584999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:09.643786 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.643756 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:09.644277 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.643872 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:09.644277 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.643909 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:09.647702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.647554 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 05:25:09.647702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.647574 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 05:25:09.649691 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.649669 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6p7zj\"" Jun 13 05:25:09.649803 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.649729 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 05:25:09.650551 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.650530 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mn5hn\"" Jun 13 05:25:09.650649 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:09.650533 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 05:25:10.261635 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:10.261596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:10.261805 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:10.261772 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:10.261864 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:10.261852 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:12.261829548 +0000 UTC m=+38.071802200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:10.414060 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:10.414031 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nx8cq"] Jun 13 05:25:10.418036 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:25:10.418005 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b4b7f8_1c30_4340_a45d_35d98cbd576a.slice/crio-6c4e450266dea2366877e381367a6e6765ef1a8e57c661a34ef25ec593dc6b95 WatchSource:0}: Error finding container 6c4e450266dea2366877e381367a6e6765ef1a8e57c661a34ef25ec593dc6b95: Status 404 returned error can't find the container with id 6c4e450266dea2366877e381367a6e6765ef1a8e57c661a34ef25ec593dc6b95 Jun 13 05:25:10.939424 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:10.939128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nx8cq" event={"ID":"46b4b7f8-1c30-4340-a45d-35d98cbd576a","Type":"ContainerStarted","Data":"6c4e450266dea2366877e381367a6e6765ef1a8e57c661a34ef25ec593dc6b95"} Jun 13 05:25:10.942337 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:10.942307 2566 generic.go:356] "Generic (PLEG): container finished" podID="806644ce-16a7-4599-be11-4bf2634a2bd5" containerID="4fd7d40d66f6443a49040484bdc3c404af613b460a870e83635b318ca50ef2da" exitCode=0 Jun 13 05:25:10.942462 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:10.942355 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerDied","Data":"4fd7d40d66f6443a49040484bdc3c404af613b460a870e83635b318ca50ef2da"} Jun 13 05:25:11.948750 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:11.948692 2566 generic.go:356] "Generic (PLEG): container finished" podID="806644ce-16a7-4599-be11-4bf2634a2bd5" containerID="c68fb7c4efdbbbccbe02686394a913134a08513e55656f9327a3c9ea0e797d33" exitCode=0 Jun 13 05:25:11.948750 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:11.948741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerDied","Data":"c68fb7c4efdbbbccbe02686394a913134a08513e55656f9327a3c9ea0e797d33"} Jun 13 05:25:12.277844 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:12.277811 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:12.277992 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:12.277970 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:12.278066 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:12.278044 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:16.278022085 +0000 UTC m=+42.087994731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:12.952329 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:12.952226 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nx8cq" event={"ID":"46b4b7f8-1c30-4340-a45d-35d98cbd576a","Type":"ContainerStarted","Data":"9d41012b299c6d4baf8e58fe9a5dbdb13b46e55eea8026521420a25b20a089cb"} Jun 13 05:25:12.955360 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:12.955333 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" event={"ID":"806644ce-16a7-4599-be11-4bf2634a2bd5","Type":"ContainerStarted","Data":"248e73c40d266ca9a517461384278f5cc5c28b4f5dc58c0ec77120d80b45ab0a"} Jun 13 05:25:12.967278 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:12.967190 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nx8cq" podStartSLOduration=2.942239262 podStartE2EDuration="4.967178359s" totalImagesPullingTime="2.024939097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:12.966421239 +0000 UTC m=+38.776393906" watchObservedRunningTime="2026-06-13 05:25:12.967178359 +0000 UTC m=+38.777151025" Jun 13 05:25:12.987663 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:12.987624 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kcrjt" podStartSLOduration=8.394644536 podStartE2EDuration="38.987611354s" totalImagesPullingTime="30.592966818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:12.985717349 +0000 UTC m=+38.795690035" watchObservedRunningTime="2026-06-13 05:25:12.987611354 +0000 UTC m=+38.797584020" Jun 13 05:25:16.306752 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:16.306717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:16.307127 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:16.306860 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:16.307127 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:16.306918 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:24.306902879 +0000 UTC m=+50.116875524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:21.759298 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.759263 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6"] Jun 13 05:25:21.769765 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.769741 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs"] Jun 13 05:25:21.769929 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.769907 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.773760 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.773513 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 13 05:25:21.773760 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.773709 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 13 05:25:21.773930 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.773517 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 13 05:25:21.775467 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.775353 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 13 05:25:21.789440 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.789419 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6"] Jun 13 05:25:21.789536 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.789461 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs"] Jun 13 05:25:21.789588 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.789534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.792072 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.792054 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 13 05:25:21.792225 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.792210 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 13 05:25:21.792323 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.792237 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 13 05:25:21.792323 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.792309 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 13 05:25:21.841393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4gr\" (UniqueName: \"kubernetes.io/projected/6859a67f-e879-4976-aff1-332aa76eaab1-kube-api-access-px4gr\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.841482 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.841482 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.841549 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99nw7\" (UniqueName: \"kubernetes.io/projected/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-kube-api-access-99nw7\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.841585 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-ca\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.841621 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-hub\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.841653 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6859a67f-e879-4976-aff1-332aa76eaab1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.841698 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6859a67f-e879-4976-aff1-332aa76eaab1-tmp\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.841735 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.841706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.942438 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4gr\" (UniqueName: \"kubernetes.io/projected/6859a67f-e879-4976-aff1-332aa76eaab1-kube-api-access-px4gr\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.942552 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.942552 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.942552 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99nw7\" (UniqueName: \"kubernetes.io/projected/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-kube-api-access-99nw7\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.942552 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-ca\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.942745 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-hub\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.942745 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6859a67f-e879-4976-aff1-332aa76eaab1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.942848 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6859a67f-e879-4976-aff1-332aa76eaab1-tmp\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.942848 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.942805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.943165 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.943140 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6859a67f-e879-4976-aff1-332aa76eaab1-tmp\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.943546 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.943525 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.946015 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.945981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-ca\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.946127 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.946041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6859a67f-e879-4976-aff1-332aa76eaab1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.946127 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.946060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-hub\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.946127 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.946091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.946299 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.946196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:21.950930 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.950903 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4gr\" (UniqueName: \"kubernetes.io/projected/6859a67f-e879-4976-aff1-332aa76eaab1-kube-api-access-px4gr\") pod \"klusterlet-addon-workmgr-5bc5446f4-6dwz6\" (UID: \"6859a67f-e879-4976-aff1-332aa76eaab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:21.951296 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:21.951277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99nw7\" (UniqueName: \"kubernetes.io/projected/0627d80f-0c0b-4cf5-aca6-b94a65d6df29-kube-api-access-99nw7\") pod \"cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs\" (UID: \"0627d80f-0c0b-4cf5-aca6-b94a65d6df29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:22.082796 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:22.082769 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:22.112564 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:22.112542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:25:22.241439 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:22.241379 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6"] Jun 13 05:25:22.245218 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:25:22.245192 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6859a67f_e879_4976_aff1_332aa76eaab1.slice/crio-cfebba68ad63f834263552ad4f622896cf53a1b1b0c6c3de4a61ac72a009526b WatchSource:0}: Error finding container cfebba68ad63f834263552ad4f622896cf53a1b1b0c6c3de4a61ac72a009526b: Status 404 returned error can't find the container with id cfebba68ad63f834263552ad4f622896cf53a1b1b0c6c3de4a61ac72a009526b Jun 13 05:25:22.254079 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:22.254052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs"] Jun 13 05:25:22.257098 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:25:22.257058 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0627d80f_0c0b_4cf5_aca6_b94a65d6df29.slice/crio-065691c6294b8b6492f79a1a791b7a34b835d11293d509524361d2d3f5ed74c2 WatchSource:0}: Error finding container 065691c6294b8b6492f79a1a791b7a34b835d11293d509524361d2d3f5ed74c2: Status 404 returned error can't find the container with id 065691c6294b8b6492f79a1a791b7a34b835d11293d509524361d2d3f5ed74c2 Jun 13 05:25:22.978707 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:22.978674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" event={"ID":"0627d80f-0c0b-4cf5-aca6-b94a65d6df29","Type":"ContainerStarted","Data":"065691c6294b8b6492f79a1a791b7a34b835d11293d509524361d2d3f5ed74c2"} Jun 13 05:25:22.979680 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:22.979657 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" event={"ID":"6859a67f-e879-4976-aff1-332aa76eaab1","Type":"ContainerStarted","Data":"cfebba68ad63f834263552ad4f622896cf53a1b1b0c6c3de4a61ac72a009526b"} Jun 13 05:25:24.359699 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:24.359666 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:24.360161 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:24.359867 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:24.360161 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:24.359926 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:40.359908378 +0000 UTC m=+66.169881027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:28.999150 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:28.999113 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" event={"ID":"0627d80f-0c0b-4cf5-aca6-b94a65d6df29","Type":"ContainerStarted","Data":"1b3e66e60d70bb10f89cc6fd5c053461feb4b7b1e4655148cab1ce0cd596f239"} Jun 13 05:25:28.999566 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:28.999164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" event={"ID":"0627d80f-0c0b-4cf5-aca6-b94a65d6df29","Type":"ContainerStarted","Data":"3bf33040a6e6a49cf3fec0c17ffcd190085a986ab542271356702cba2752c41c"} Jun 13 05:25:28.999566 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:28.999183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" event={"ID":"0627d80f-0c0b-4cf5-aca6-b94a65d6df29","Type":"ContainerStarted","Data":"8cd014911ba29c9d703b3677deeb9ab3f831a4eb811b4a5fec2800feca54888c"} Jun 13 05:25:29.000483 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:29.000463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" event={"ID":"6859a67f-e879-4976-aff1-332aa76eaab1","Type":"ContainerStarted","Data":"e90a7ba57c974eb9d31a0bf8c797d400c70a34a72dfdd7aa82784a448fe6df47"} Jun 13 05:25:29.000653 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:29.000637 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:29.002160 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:29.002142 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:25:29.016820 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:29.016778 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" podStartSLOduration=1.834897195 podStartE2EDuration="8.016766352s" totalImagesPullingTime="6.181869157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:29.01623744 +0000 UTC m=+54.826210105" watchObservedRunningTime="2026-06-13 05:25:29.016766352 +0000 UTC m=+54.826739019" Jun 13 05:25:29.030231 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:29.030194 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" podStartSLOduration=1.835270486 podStartE2EDuration="8.030181101s" totalImagesPullingTime="6.194910615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:29.029394979 +0000 UTC m=+54.839367666" watchObservedRunningTime="2026-06-13 05:25:29.030181101 +0000 UTC m=+54.840153768" Jun 13 05:25:33.934372 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:33.934336 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccnvt" Jun 13 05:25:39.466447 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.466409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:39.466447 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.466454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:25:39.468934 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.468916 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 05:25:39.468991 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.468937 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 05:25:39.477071 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:39.477054 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 05:25:39.477143 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:39.477132 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:26:43.477111915 +0000 UTC m=+129.287084571 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : secret "metrics-daemon-secret" not found Jun 13 05:25:39.479198 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.479183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63212e1d-8ecf-438b-ba7c-00dd6809dec4-original-pull-secret\") pod \"global-pull-secret-syncer-2bpsg\" (UID: \"63212e1d-8ecf-438b-ba7c-00dd6809dec4\") " pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:39.566898 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.566875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:39.569569 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.569553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 05:25:39.579733 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.579717 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 05:25:39.590676 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.590652 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqvnf\" (UniqueName: \"kubernetes.io/projected/691a24b0-b545-4206-b229-06b3972e0908-kube-api-access-gqvnf\") pod \"network-check-target-ws94t\" (UID: \"691a24b0-b545-4206-b229-06b3972e0908\") " pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:39.658999 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.658981 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2bpsg" Jun 13 05:25:39.666785 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.666764 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6p7zj\"" Jun 13 05:25:39.674888 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.674869 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:39.786909 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.786878 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2bpsg"] Jun 13 05:25:39.789845 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:25:39.789818 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63212e1d_8ecf_438b_ba7c_00dd6809dec4.slice/crio-155c2ec77e8b030c039ab0273ae8ce4e2cf9f4eccdfd3e23669efb7071e1c38c WatchSource:0}: Error finding container 155c2ec77e8b030c039ab0273ae8ce4e2cf9f4eccdfd3e23669efb7071e1c38c: Status 404 returned error can't find the container with id 155c2ec77e8b030c039ab0273ae8ce4e2cf9f4eccdfd3e23669efb7071e1c38c Jun 13 05:25:39.800272 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:39.800233 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ws94t"] Jun 13 05:25:39.802594 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:25:39.802574 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691a24b0_b545_4206_b229_06b3972e0908.slice/crio-795d01c3f59c899eeafba77af3215ebe0da4e61a945e4b01133176e8d80ec81a WatchSource:0}: Error finding container 795d01c3f59c899eeafba77af3215ebe0da4e61a945e4b01133176e8d80ec81a: Status 404 returned error can't find the container with id 795d01c3f59c899eeafba77af3215ebe0da4e61a945e4b01133176e8d80ec81a Jun 13 05:25:40.026906 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:40.026874 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2bpsg" event={"ID":"63212e1d-8ecf-438b-ba7c-00dd6809dec4","Type":"ContainerStarted","Data":"155c2ec77e8b030c039ab0273ae8ce4e2cf9f4eccdfd3e23669efb7071e1c38c"} Jun 13 05:25:40.027786 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:40.027765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ws94t" event={"ID":"691a24b0-b545-4206-b229-06b3972e0908","Type":"ContainerStarted","Data":"795d01c3f59c899eeafba77af3215ebe0da4e61a945e4b01133176e8d80ec81a"} Jun 13 05:25:40.372426 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:40.372348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:25:40.372574 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:40.372501 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:40.372635 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:25:40.372575 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:26:12.37255706 +0000 UTC m=+98.182529704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:25:45.042586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:45.042543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ws94t" event={"ID":"691a24b0-b545-4206-b229-06b3972e0908","Type":"ContainerStarted","Data":"f24d87bb309ed5368f969f2b1e2159d82cda31e34dddf2666e32fd5939699306"} Jun 13 05:25:45.043080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:45.042688 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:25:45.043838 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:45.043817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2bpsg" event={"ID":"63212e1d-8ecf-438b-ba7c-00dd6809dec4","Type":"ContainerStarted","Data":"025e5e481ed205cdb94ce7d83d23a26a63a7d40c3a9eb142ca0dd5b61613d0ac"} Jun 13 05:25:45.059177 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:45.059137 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ws94t" podStartSLOduration=66.527886346 podStartE2EDuration="1m11.059126779s" totalImagesPullingTime="4.531240433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:45.057709728 +0000 UTC m=+70.867682395" watchObservedRunningTime="2026-06-13 05:25:45.059126779 +0000 UTC m=+70.869099443" Jun 13 05:25:45.072460 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:25:45.072426 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2bpsg" podStartSLOduration=66.525143573 podStartE2EDuration="1m11.072416216s" totalImagesPullingTime="4.547272643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:45.072262246 +0000 UTC m=+70.882234904" watchObservedRunningTime="2026-06-13 05:25:45.072416216 +0000 UTC m=+70.882388880" Jun 13 05:26:12.377298 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:26:12.377149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:26:12.377298 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:26:12.377279 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:26:12.377707 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:26:12.377342 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:27:16.377327489 +0000 UTC m=+162.187300134 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:26:16.049149 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:26:16.049120 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ws94t" Jun 13 05:26:43.570177 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:26:43.570142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:26:43.570605 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:26:43.570283 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 05:26:43.570605 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:26:43.570335 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs podName:93bc553b-de82-4307-93d9-b909bcbe2069 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:45.570322036 +0000 UTC m=+251.380294682 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs") pod "network-metrics-daemon-lvpgj" (UID: "93bc553b-de82-4307-93d9-b909bcbe2069") : secret "metrics-daemon-secret" not found Jun 13 05:27:11.570863 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:11.570827 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qt2dt" podUID="456a212c-6a21-4304-ae5a-9343986e6cd8" Jun 13 05:27:12.280358 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:12.280329 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt2dt" Jun 13 05:27:12.670906 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:12.670826 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lvpgj" podUID="93bc553b-de82-4307-93d9-b909bcbe2069" Jun 13 05:27:16.381942 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:16.381910 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:27:16.382321 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:16.382006 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:27:16.382321 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:16.382053 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls podName:456a212c-6a21-4304-ae5a-9343986e6cd8 nodeName:}" failed. No retries permitted until 2026-06-13 05:29:18.382041376 +0000 UTC m=+284.192014026 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls") pod "dns-default-qt2dt" (UID: "456a212c-6a21-4304-ae5a-9343986e6cd8") : secret "dns-default-metrics-tls" not found Jun 13 05:27:23.643409 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:23.643329 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:27:29.001828 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:29.001753 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" podUID="6859a67f-e879-4976-aff1-332aa76eaab1" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 13 05:27:29.328705 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:29.328675 2566 generic.go:356] "Generic (PLEG): container finished" podID="6859a67f-e879-4976-aff1-332aa76eaab1" containerID="e90a7ba57c974eb9d31a0bf8c797d400c70a34a72dfdd7aa82784a448fe6df47" exitCode=1 Jun 13 05:27:29.328855 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:29.328721 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" event={"ID":"6859a67f-e879-4976-aff1-332aa76eaab1","Type":"ContainerDied","Data":"e90a7ba57c974eb9d31a0bf8c797d400c70a34a72dfdd7aa82784a448fe6df47"} Jun 13 05:27:29.329011 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:29.329000 2566 scope.go:117] "RemoveContainer" containerID="e90a7ba57c974eb9d31a0bf8c797d400c70a34a72dfdd7aa82784a448fe6df47" Jun 13 05:27:30.333218 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:30.333185 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" event={"ID":"6859a67f-e879-4976-aff1-332aa76eaab1","Type":"ContainerStarted","Data":"e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba"} Jun 13 05:27:30.333584 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:30.333483 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:27:30.334103 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:30.334086 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:27:58.273745 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.273705 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mbmw9"] Jun 13 05:27:58.275739 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.275719 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.278031 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.278000 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 05:27:58.278178 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.278153 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mkwd2\"" Jun 13 05:27:58.279168 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.279151 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 05:27:58.279271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.279196 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 05:27:58.279271 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.279196 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 05:27:58.287287 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.287265 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbmw9"] Jun 13 05:27:58.343865 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.343840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pn2p\" (UniqueName: \"kubernetes.io/projected/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-api-access-8pn2p\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.344009 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.343896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/743aba5e-b336-4c13-aef1-13ecd9aeaecf-crio-socket\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.344009 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.343925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.344009 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.343971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/743aba5e-b336-4c13-aef1-13ecd9aeaecf-data-volume\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.344009 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.343993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445170 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445140 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/743aba5e-b336-4c13-aef1-13ecd9aeaecf-crio-socket\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445170 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445203 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/743aba5e-b336-4c13-aef1-13ecd9aeaecf-data-volume\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445221 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pn2p\" (UniqueName: \"kubernetes.io/projected/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-api-access-8pn2p\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445289 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/743aba5e-b336-4c13-aef1-13ecd9aeaecf-crio-socket\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.445317 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.445362 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:27:58.445412 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.445389 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:27:58.94537014 +0000 UTC m=+204.755342786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : secret "insights-runtime-extractor-tls" not found Jun 13 05:27:58.445654 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.445432 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:27:58.945413439 +0000 UTC m=+204.755386105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : configmap "kube-rbac-proxy" not found Jun 13 05:27:58.445654 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.445523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/743aba5e-b336-4c13-aef1-13ecd9aeaecf-data-volume\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.454490 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.454462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pn2p\" (UniqueName: \"kubernetes.io/projected/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-api-access-8pn2p\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.948056 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.948016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.948226 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:58.948096 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:58.948226 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.948139 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:27:58.948226 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.948187 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:27:58.948226 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.948216 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:27:59.948200017 +0000 UTC m=+205.758172661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : configmap "kube-rbac-proxy" not found Jun 13 05:27:58.948436 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:58.948231 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:27:59.948225051 +0000 UTC m=+205.758197695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : secret "insights-runtime-extractor-tls" not found Jun 13 05:27:59.954868 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:59.954836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:59.955335 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:27:59.954880 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:27:59.955335 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:59.954956 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:27:59.955335 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:59.954974 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:27:59.955335 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:59.955014 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:28:01.955000844 +0000 UTC m=+207.764973489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : configmap "kube-rbac-proxy" not found Jun 13 05:27:59.955335 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:27:59.955028 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:28:01.955021474 +0000 UTC m=+207.764994119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : secret "insights-runtime-extractor-tls" not found Jun 13 05:28:00.860422 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:00.860394 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7lgq_6ddddc73-e38f-48b8-ac72-ece19246ba96/dns-node-resolver/0.log" Jun 13 05:28:01.971481 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:01.971445 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:01.971887 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:01.971502 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:01.971887 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:01.971601 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:28:01.971887 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:01.971612 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:28:01.971887 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:01.971664 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:28:05.971647083 +0000 UTC m=+211.781619732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : secret "insights-runtime-extractor-tls" not found Jun 13 05:28:01.971887 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:01.971680 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:28:05.971673549 +0000 UTC m=+211.781646194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : configmap "kube-rbac-proxy" not found Jun 13 05:28:02.063272 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:02.063230 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m982k_f7207946-297b-4717-9bc1-f8881a1fe3de/node-ca/0.log" Jun 13 05:28:03.061035 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:03.061007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nx8cq_46b4b7f8-1c30-4340-a45d-35d98cbd576a/serve-healthcheck-canary/0.log" Jun 13 05:28:06.000664 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:06.000622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:06.001077 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:06.000682 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:06.001077 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:06.000744 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:28:06.001077 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:06.000768 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:28:06.001077 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:06.000814 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:28:14.000798572 +0000 UTC m=+219.810771230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : configmap "kube-rbac-proxy" not found Jun 13 05:28:06.001077 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:06.000828 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls podName:743aba5e-b336-4c13-aef1-13ecd9aeaecf nodeName:}" failed. No retries permitted until 2026-06-13 05:28:14.000822661 +0000 UTC m=+219.810795305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbmw9" (UID: "743aba5e-b336-4c13-aef1-13ecd9aeaecf") : secret "insights-runtime-extractor-tls" not found Jun 13 05:28:14.054392 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.054357 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:14.054856 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.054402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:14.054856 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.054846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743aba5e-b336-4c13-aef1-13ecd9aeaecf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:14.056669 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.056647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743aba5e-b336-4c13-aef1-13ecd9aeaecf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbmw9\" (UID: \"743aba5e-b336-4c13-aef1-13ecd9aeaecf\") " pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:14.185178 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.185152 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbmw9" Jun 13 05:28:14.302022 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.301992 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbmw9"] Jun 13 05:28:14.305463 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:28:14.305395 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743aba5e_b336_4c13_aef1_13ecd9aeaecf.slice/crio-19f279d11208c5fe05d16239b800c0e9ef8a7323cd77c17a6c6287704da77462 WatchSource:0}: Error finding container 19f279d11208c5fe05d16239b800c0e9ef8a7323cd77c17a6c6287704da77462: Status 404 returned error can't find the container with id 19f279d11208c5fe05d16239b800c0e9ef8a7323cd77c17a6c6287704da77462 Jun 13 05:28:14.458617 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:14.458577 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbmw9" event={"ID":"743aba5e-b336-4c13-aef1-13ecd9aeaecf","Type":"ContainerStarted","Data":"19f279d11208c5fe05d16239b800c0e9ef8a7323cd77c17a6c6287704da77462"} Jun 13 05:28:17.993278 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:17.992195 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-857b8d564b-zfgfh"] Jun 13 05:28:17.995209 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:17.995189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:17.997637 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:17.997615 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 05:28:17.997857 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:17.997840 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 05:28:17.997953 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:17.997869 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 05:28:17.997953 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:17.997849 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tdxg2\"" Jun 13 05:28:18.003051 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.003032 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 05:28:18.005600 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.005577 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-857b8d564b-zfgfh"] Jun 13 05:28:18.085210 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-installation-pull-secrets\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085210 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-ca-trust-extracted\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085361 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085219 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-trusted-ca\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085361 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-bound-sa-token\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085361 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjrb\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-kube-api-access-9jjrb\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085361 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-registry-tls\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085483 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-image-registry-private-configuration\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.085483 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.085428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-registry-certificates\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.185995 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.185969 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-installation-pull-secrets\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-ca-trust-extracted\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-trusted-ca\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-bound-sa-token\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjrb\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-kube-api-access-9jjrb\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186118 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-registry-tls\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-image-registry-private-configuration\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186424 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-registry-certificates\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.186529 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.186505 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-ca-trust-extracted\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.187038 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.187013 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-registry-certificates\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.187216 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.187198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-trusted-ca\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.188576 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.188550 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-image-registry-private-configuration\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.188664 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.188632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-installation-pull-secrets\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.188744 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.188722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-registry-tls\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.193874 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.193851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-bound-sa-token\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.193967 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.193944 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjrb\" (UniqueName: \"kubernetes.io/projected/f2ea84a0-53ef-460c-bca4-31aa27cf0d4f-kube-api-access-9jjrb\") pod \"image-registry-857b8d564b-zfgfh\" (UID: \"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f\") " pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.305108 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.305086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:18.432761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.432727 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-857b8d564b-zfgfh"] Jun 13 05:28:18.473060 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:18.473022 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbmw9" event={"ID":"743aba5e-b336-4c13-aef1-13ecd9aeaecf","Type":"ContainerStarted","Data":"e8e6f0253b54cb5fbe0880edcd64f5a80161364c73556a9295096511eced8ffb"} Jun 13 05:28:18.501394 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:28:18.501359 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ea84a0_53ef_460c_bca4_31aa27cf0d4f.slice/crio-95cb82668fc4795a671a0c0d761624d0a4befb39b3d3be95afc2a37994f046b4 WatchSource:0}: Error finding container 95cb82668fc4795a671a0c0d761624d0a4befb39b3d3be95afc2a37994f046b4: Status 404 returned error can't find the container with id 95cb82668fc4795a671a0c0d761624d0a4befb39b3d3be95afc2a37994f046b4 Jun 13 05:28:19.479313 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:19.479274 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbmw9" event={"ID":"743aba5e-b336-4c13-aef1-13ecd9aeaecf","Type":"ContainerStarted","Data":"d62f34599479c9358bf7f934223cab502382cd8388246f259ba5f9d41545577d"} Jun 13 05:28:19.480962 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:19.480916 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" event={"ID":"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f","Type":"ContainerStarted","Data":"31fd4c94e468e7d2016e6b1db09c4ad75d08019c6cd38346eb4f03a642a25b5c"} Jun 13 05:28:19.480962 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:19.480962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" event={"ID":"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f","Type":"ContainerStarted","Data":"95cb82668fc4795a671a0c0d761624d0a4befb39b3d3be95afc2a37994f046b4"} Jun 13 05:28:19.481154 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:19.481030 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:19.501724 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:19.501679 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podStartSLOduration=2.501662951 podStartE2EDuration="2.501662951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:19.499635415 +0000 UTC m=+225.309608081" watchObservedRunningTime="2026-06-13 05:28:19.501662951 +0000 UTC m=+225.311635618" Jun 13 05:28:21.488362 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:21.488333 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbmw9" event={"ID":"743aba5e-b336-4c13-aef1-13ecd9aeaecf","Type":"ContainerStarted","Data":"a9b7e1835f0cecd582c29f3936807f184350594d86f763b0ecfee6fc4c456816"} Jun 13 05:28:21.508169 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:21.507444 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mbmw9" podStartSLOduration=17.423753934 podStartE2EDuration="23.50742526s" totalImagesPullingTime="6.083671326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:27:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:21.504812738 +0000 UTC m=+227.314785405" watchObservedRunningTime="2026-06-13 05:28:21.50742526 +0000 UTC m=+227.317397929" Jun 13 05:28:26.564736 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.564703 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zcpq6"] Jun 13 05:28:26.567532 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.567517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.569861 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.569804 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 05:28:26.570350 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.570092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 05:28:26.570451 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.570393 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 05:28:26.570451 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.570393 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 05:28:26.571375 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.571352 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 05:28:26.571491 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.571399 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 05:28:26.571543 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.571530 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bdkzl\"" Jun 13 05:28:26.643500 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-tls\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643638 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-sys\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643638 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643705 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb88a316-bf0f-48a9-95b8-de9140c6f414-metrics-client-ca\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643705 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643705 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-root\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-textfile\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643816 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-wtmp\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.643934 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.643861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhsns\" (UniqueName: \"kubernetes.io/projected/cb88a316-bf0f-48a9-95b8-de9140c6f414-kube-api-access-dhsns\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744493 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb88a316-bf0f-48a9-95b8-de9140c6f414-metrics-client-ca\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744532 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-root\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-textfile\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-wtmp\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhsns\" (UniqueName: \"kubernetes.io/projected/cb88a316-bf0f-48a9-95b8-de9140c6f414-kube-api-access-dhsns\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-tls\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.744667 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-sys\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.745030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-root\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.745030 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:26.744788 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 05:28:26.745030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744794 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-wtmp\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.745030 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:28:26.744849 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-tls podName:cb88a316-bf0f-48a9-95b8-de9140c6f414 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:27.244829363 +0000 UTC m=+233.054802023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-tls") pod "node-exporter-zcpq6" (UID: "cb88a316-bf0f-48a9-95b8-de9140c6f414") : secret "node-exporter-tls" not found Jun 13 05:28:26.745030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.744848 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb88a316-bf0f-48a9-95b8-de9140c6f414-sys\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.745030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.745002 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-textfile\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.745229 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.745130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb88a316-bf0f-48a9-95b8-de9140c6f414-metrics-client-ca\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.745229 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.745130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.746821 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.746803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:26.754392 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:26.754373 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhsns\" (UniqueName: \"kubernetes.io/projected/cb88a316-bf0f-48a9-95b8-de9140c6f414-kube-api-access-dhsns\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:27.249507 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:27.249472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-tls\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:27.254855 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:27.254820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb88a316-bf0f-48a9-95b8-de9140c6f414-node-exporter-tls\") pod \"node-exporter-zcpq6\" (UID: \"cb88a316-bf0f-48a9-95b8-de9140c6f414\") " pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:27.476974 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:27.476921 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcpq6" Jun 13 05:28:27.486068 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:28:27.486043 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb88a316_bf0f_48a9_95b8_de9140c6f414.slice/crio-dbe17034abc6c67fb88fd4c74aea7d84e781188d1fe8e853095cfa1193b13e8b WatchSource:0}: Error finding container dbe17034abc6c67fb88fd4c74aea7d84e781188d1fe8e853095cfa1193b13e8b: Status 404 returned error can't find the container with id dbe17034abc6c67fb88fd4c74aea7d84e781188d1fe8e853095cfa1193b13e8b Jun 13 05:28:27.507163 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:27.507105 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcpq6" event={"ID":"cb88a316-bf0f-48a9-95b8-de9140c6f414","Type":"ContainerStarted","Data":"dbe17034abc6c67fb88fd4c74aea7d84e781188d1fe8e853095cfa1193b13e8b"} Jun 13 05:28:28.511871 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:28.511842 2566 generic.go:356] "Generic (PLEG): container finished" podID="cb88a316-bf0f-48a9-95b8-de9140c6f414" containerID="25e69fb807beb43fcd201bb2b7da8de8eb945759d8a9af68618d3fd277aa601f" exitCode=0 Jun 13 05:28:28.512218 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:28.511894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcpq6" event={"ID":"cb88a316-bf0f-48a9-95b8-de9140c6f414","Type":"ContainerDied","Data":"25e69fb807beb43fcd201bb2b7da8de8eb945759d8a9af68618d3fd277aa601f"} Jun 13 05:28:29.517836 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:29.517800 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcpq6" event={"ID":"cb88a316-bf0f-48a9-95b8-de9140c6f414","Type":"ContainerStarted","Data":"6c3511991da374a45765b5f78bc8d4a2c320623d4cba5c390d8e006e2fb6e0ab"} Jun 13 05:28:29.518259 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:29.517853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcpq6" event={"ID":"cb88a316-bf0f-48a9-95b8-de9140c6f414","Type":"ContainerStarted","Data":"d8c036dc47461cf6d3d42599a9fc10274b3f3a151bbf9002d6adba3146c4ceda"} Jun 13 05:28:29.539462 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:29.539417 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zcpq6" podStartSLOduration=2.6370772970000003 podStartE2EDuration="3.539403061s" totalImagesPullingTime="838.386807ms" totalInitContainerRuntime="63.938957ms" isStatefulPod=true podCreationTimestamp="2026-06-13 05:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:29.538639678 +0000 UTC m=+235.348612352" watchObservedRunningTime="2026-06-13 05:28:29.539403061 +0000 UTC m=+235.349375747" Jun 13 05:28:30.863760 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.863724 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-789cf76cbc-85dtt"] Jun 13 05:28:30.865717 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.865701 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.868156 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.868134 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 13 05:28:30.869326 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.869303 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 05:28:30.869326 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.869322 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-11fdp07fkbura\"" Jun 13 05:28:30.869495 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.869303 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 13 05:28:30.869495 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.869350 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 13 05:28:30.869495 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.869367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wgq9n\"" Jun 13 05:28:30.874586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.874559 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-789cf76cbc-85dtt"] Jun 13 05:28:30.980824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.980794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834368de-0907-4b20-8bfe-06e90f033710-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.980824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.980826 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-client-ca-bundle\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.981061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.980855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/834368de-0907-4b20-8bfe-06e90f033710-metrics-server-audit-profiles\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.981061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.980888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdsms\" (UniqueName: \"kubernetes.io/projected/834368de-0907-4b20-8bfe-06e90f033710-kube-api-access-wdsms\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.981061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.980907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-secret-metrics-server-client-certs\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.981061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.980926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-secret-metrics-server-tls\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:30.981061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:30.981001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/834368de-0907-4b20-8bfe-06e90f033710-audit-log\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082016 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.081961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/834368de-0907-4b20-8bfe-06e90f033710-audit-log\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834368de-0907-4b20-8bfe-06e90f033710-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-client-ca-bundle\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082092 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/834368de-0907-4b20-8bfe-06e90f033710-metrics-server-audit-profiles\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdsms\" (UniqueName: \"kubernetes.io/projected/834368de-0907-4b20-8bfe-06e90f033710-kube-api-access-wdsms\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-secret-metrics-server-client-certs\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082475 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-secret-metrics-server-tls\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082475 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/834368de-0907-4b20-8bfe-06e90f033710-audit-log\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.082979 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.082952 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834368de-0907-4b20-8bfe-06e90f033710-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.083174 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.083154 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/834368de-0907-4b20-8bfe-06e90f033710-metrics-server-audit-profiles\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.084703 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.084674 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-client-ca-bundle\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.084799 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.084685 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-secret-metrics-server-tls\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.084799 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.084729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/834368de-0907-4b20-8bfe-06e90f033710-secret-metrics-server-client-certs\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.089746 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.089729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdsms\" (UniqueName: \"kubernetes.io/projected/834368de-0907-4b20-8bfe-06e90f033710-kube-api-access-wdsms\") pod \"metrics-server-789cf76cbc-85dtt\" (UID: \"834368de-0907-4b20-8bfe-06e90f033710\") " pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.175351 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.175280 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:31.299891 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.299858 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-789cf76cbc-85dtt"] Jun 13 05:28:31.302627 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:28:31.302586 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834368de_0907_4b20_8bfe_06e90f033710.slice/crio-3bfb69c835d318574a2533419e65659cd30f31090216f3e5f12ab517083aecae WatchSource:0}: Error finding container 3bfb69c835d318574a2533419e65659cd30f31090216f3e5f12ab517083aecae: Status 404 returned error can't find the container with id 3bfb69c835d318574a2533419e65659cd30f31090216f3e5f12ab517083aecae Jun 13 05:28:31.525682 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:31.525647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" event={"ID":"834368de-0907-4b20-8bfe-06e90f033710","Type":"ContainerStarted","Data":"3bfb69c835d318574a2533419e65659cd30f31090216f3e5f12ab517083aecae"} Jun 13 05:28:33.533579 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:33.533541 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" event={"ID":"834368de-0907-4b20-8bfe-06e90f033710","Type":"ContainerStarted","Data":"941dde261f2cd02ccd1148ef14220e7e68b84fe55ab5fe81db2558fc5ae1d7ee"} Jun 13 05:28:33.549815 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:33.549767 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" podStartSLOduration=2.184833811 podStartE2EDuration="3.549752314s" totalImagesPullingTime="1.364918503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:33.548710114 +0000 UTC m=+239.358682792" watchObservedRunningTime="2026-06-13 05:28:33.549752314 +0000 UTC m=+239.359724975" Jun 13 05:28:38.310207 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:38.310168 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:28:38.310615 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:38.310220 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:28:40.488794 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:40.488759 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:28:40.489261 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:40.488817 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:28:45.596210 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:45.596174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:28:45.598377 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:45.598355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93bc553b-de82-4307-93d9-b909bcbe2069-metrics-certs\") pod \"network-metrics-daemon-lvpgj\" (UID: \"93bc553b-de82-4307-93d9-b909bcbe2069\") " pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:28:45.846319 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:45.846224 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mn5hn\"" Jun 13 05:28:45.854199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:45.854181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvpgj" Jun 13 05:28:46.098520 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:46.098452 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvpgj"] Jun 13 05:28:46.101819 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:28:46.101797 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bc553b_de82_4307_93d9_b909bcbe2069.slice/crio-218cbd990ef80f780d7d73f246ee84157ac81f9bb1ee68b8ccaf1fb6d248308e WatchSource:0}: Error finding container 218cbd990ef80f780d7d73f246ee84157ac81f9bb1ee68b8ccaf1fb6d248308e: Status 404 returned error can't find the container with id 218cbd990ef80f780d7d73f246ee84157ac81f9bb1ee68b8ccaf1fb6d248308e Jun 13 05:28:46.576566 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:46.576528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvpgj" event={"ID":"93bc553b-de82-4307-93d9-b909bcbe2069","Type":"ContainerStarted","Data":"218cbd990ef80f780d7d73f246ee84157ac81f9bb1ee68b8ccaf1fb6d248308e"} Jun 13 05:28:48.311579 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:48.311540 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:28:48.311922 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:48.311600 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:28:48.587702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:48.587617 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvpgj" event={"ID":"93bc553b-de82-4307-93d9-b909bcbe2069","Type":"ContainerStarted","Data":"fef89376e009ca71436c090e4a3403165b10082978509d1c2985f9f691f199d2"} Jun 13 05:28:48.587702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:48.587695 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvpgj" event={"ID":"93bc553b-de82-4307-93d9-b909bcbe2069","Type":"ContainerStarted","Data":"b1cbf9e8291a8c477e88606be3924bad85b5e287a3f2a2eac256206fed24cf4c"} Jun 13 05:28:48.601736 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:48.601615 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lvpgj" podStartSLOduration=253.161982817 podStartE2EDuration="4m14.601599375s" totalImagesPullingTime="1.439616558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:48.601190737 +0000 UTC m=+254.411163447" watchObservedRunningTime="2026-06-13 05:28:48.601599375 +0000 UTC m=+254.411572043" Jun 13 05:28:50.488182 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:50.488150 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:28:50.488629 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:50.488203 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:28:51.176225 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:51.176193 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:51.176402 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:51.176256 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:28:58.309487 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:58.309408 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:28:58.309487 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:58.309469 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:28:58.309957 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:58.309510 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:28:58.309957 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:58.309933 2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"31fd4c94e468e7d2016e6b1db09c4ad75d08019c6cd38346eb4f03a642a25b5c"} pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" containerMessage="Container registry failed liveness probe, will be restarted" Jun 13 05:28:58.313556 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:58.313530 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:28:58.313690 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:28:58.313586 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:29:08.314211 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:08.314169 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:29:08.314702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:08.314224 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:29:11.181190 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:11.181162 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:29:11.185162 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:11.185141 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-789cf76cbc-85dtt" Jun 13 05:29:12.113662 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:12.113626 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" podUID="0627d80f-0c0b-4cf5-aca6-b94a65d6df29" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 05:29:15.281294 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:29:15.281228 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qt2dt" podUID="456a212c-6a21-4304-ae5a-9343986e6cd8" Jun 13 05:29:15.670409 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:15.670324 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt2dt" Jun 13 05:29:18.314616 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.314580 2566 patch_prober.go:28] interesting pod/image-registry-857b8d564b-zfgfh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:29:18.315079 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.314657 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:29:18.423030 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.423000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:29:18.425138 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.425121 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456a212c-6a21-4304-ae5a-9343986e6cd8-metrics-tls\") pod \"dns-default-qt2dt\" (UID: \"456a212c-6a21-4304-ae5a-9343986e6cd8\") " pod="openshift-dns/dns-default-qt2dt" Jun 13 05:29:18.673908 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.673832 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-24sgs\"" Jun 13 05:29:18.681612 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.681587 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt2dt" Jun 13 05:29:18.830998 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:18.830973 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qt2dt"] Jun 13 05:29:18.833161 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:29:18.833138 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456a212c_6a21_4304_ae5a_9343986e6cd8.slice/crio-bd0ca2ddbc56d6897e04d4ac2969b6c6b2255d5d1d49b5600fd1c0ed1f56b1e4 WatchSource:0}: Error finding container bd0ca2ddbc56d6897e04d4ac2969b6c6b2255d5d1d49b5600fd1c0ed1f56b1e4: Status 404 returned error can't find the container with id bd0ca2ddbc56d6897e04d4ac2969b6c6b2255d5d1d49b5600fd1c0ed1f56b1e4 Jun 13 05:29:19.683181 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:19.683145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt2dt" event={"ID":"456a212c-6a21-4304-ae5a-9343986e6cd8","Type":"ContainerStarted","Data":"bd0ca2ddbc56d6897e04d4ac2969b6c6b2255d5d1d49b5600fd1c0ed1f56b1e4"} Jun 13 05:29:20.687993 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:20.687907 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt2dt" event={"ID":"456a212c-6a21-4304-ae5a-9343986e6cd8","Type":"ContainerStarted","Data":"2808797c38761dda7b92848d680e08c4c41fa44cc3b1dc796249d3d2da67a143"} Jun 13 05:29:20.687993 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:20.687960 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt2dt" event={"ID":"456a212c-6a21-4304-ae5a-9343986e6cd8","Type":"ContainerStarted","Data":"7687a49ab8564e9f4eb1c101560894a86bb121514486fda84a987caf210c2465"} Jun 13 05:29:20.688394 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:20.688191 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qt2dt" Jun 13 05:29:20.704869 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:20.704826 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qt2dt" podStartSLOduration=251.261601975 podStartE2EDuration="4m12.704812474s" totalImagesPullingTime="1.443210499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:29:20.703727506 +0000 UTC m=+286.513700171" watchObservedRunningTime="2026-06-13 05:29:20.704812474 +0000 UTC m=+286.514785141" Jun 13 05:29:22.114099 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:22.114061 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" podUID="0627d80f-0c0b-4cf5-aca6-b94a65d6df29" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 05:29:23.329015 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:23.328968 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" podUID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerName="registry" containerID="cri-o://31fd4c94e468e7d2016e6b1db09c4ad75d08019c6cd38346eb4f03a642a25b5c" gracePeriod=30 Jun 13 05:29:24.705747 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:24.705655 2566 generic.go:356] "Generic (PLEG): container finished" podID="f2ea84a0-53ef-460c-bca4-31aa27cf0d4f" containerID="31fd4c94e468e7d2016e6b1db09c4ad75d08019c6cd38346eb4f03a642a25b5c" exitCode=0 Jun 13 05:29:24.705747 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:24.705722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" event={"ID":"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f","Type":"ContainerDied","Data":"31fd4c94e468e7d2016e6b1db09c4ad75d08019c6cd38346eb4f03a642a25b5c"} Jun 13 05:29:24.706256 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:24.705772 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" event={"ID":"f2ea84a0-53ef-460c-bca4-31aa27cf0d4f","Type":"ContainerStarted","Data":"e0931aa21ea774b5cf9dcae92836403f0f6faa93a54cd4deaece6c573ddc6b79"} Jun 13 05:29:24.706256 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:24.705956 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:29:29.723313 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:29.723191 2566 generic.go:356] "Generic (PLEG): container finished" podID="6859a67f-e879-4976-aff1-332aa76eaab1" containerID="e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba" exitCode=1 Jun 13 05:29:29.723313 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:29.723266 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" event={"ID":"6859a67f-e879-4976-aff1-332aa76eaab1","Type":"ContainerDied","Data":"e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba"} Jun 13 05:29:29.723774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:29.723332 2566 scope.go:117] "RemoveContainer" containerID="e90a7ba57c974eb9d31a0bf8c797d400c70a34a72dfdd7aa82784a448fe6df47" Jun 13 05:29:29.723774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:29.723670 2566 scope.go:117] "RemoveContainer" containerID="e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba" Jun 13 05:29:29.723875 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:29:29.723851 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5bc5446f4-6dwz6_open-cluster-management-agent-addon(6859a67f-e879-4976-aff1-332aa76eaab1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" podUID="6859a67f-e879-4976-aff1-332aa76eaab1" Jun 13 05:29:30.334161 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:30.334129 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:29:30.695691 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:30.695614 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qt2dt" Jun 13 05:29:30.729588 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:30.729556 2566 scope.go:117] "RemoveContainer" containerID="e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba" Jun 13 05:29:30.730045 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:29:30.729715 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5bc5446f4-6dwz6_open-cluster-management-agent-addon(6859a67f-e879-4976-aff1-332aa76eaab1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" podUID="6859a67f-e879-4976-aff1-332aa76eaab1" Jun 13 05:29:32.083105 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.083063 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:29:32.083596 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.083551 2566 scope.go:117] "RemoveContainer" containerID="e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba" Jun 13 05:29:32.083762 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:29:32.083738 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5bc5446f4-6dwz6_open-cluster-management-agent-addon(6859a67f-e879-4976-aff1-332aa76eaab1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" podUID="6859a67f-e879-4976-aff1-332aa76eaab1" Jun 13 05:29:32.113804 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.113776 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" podUID="0627d80f-0c0b-4cf5-aca6-b94a65d6df29" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 05:29:32.113929 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.113832 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" Jun 13 05:29:32.114306 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.114289 2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1b3e66e60d70bb10f89cc6fd5c053461feb4b7b1e4655148cab1ce0cd596f239"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 13 05:29:32.114342 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.114323 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" podUID="0627d80f-0c0b-4cf5-aca6-b94a65d6df29" containerName="service-proxy" containerID="cri-o://1b3e66e60d70bb10f89cc6fd5c053461feb4b7b1e4655148cab1ce0cd596f239" gracePeriod=30 Jun 13 05:29:32.623346 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.623318 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-789cf76cbc-85dtt_834368de-0907-4b20-8bfe-06e90f033710/metrics-server/0.log" Jun 13 05:29:32.738123 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.738091 2566 generic.go:356] "Generic (PLEG): container finished" podID="0627d80f-0c0b-4cf5-aca6-b94a65d6df29" containerID="1b3e66e60d70bb10f89cc6fd5c053461feb4b7b1e4655148cab1ce0cd596f239" exitCode=2 Jun 13 05:29:32.738303 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.738164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" event={"ID":"0627d80f-0c0b-4cf5-aca6-b94a65d6df29","Type":"ContainerDied","Data":"1b3e66e60d70bb10f89cc6fd5c053461feb4b7b1e4655148cab1ce0cd596f239"} Jun 13 05:29:32.738303 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:32.738208 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68dbd6cbb9-ptwzs" event={"ID":"0627d80f-0c0b-4cf5-aca6-b94a65d6df29","Type":"ContainerStarted","Data":"054899296efaf577951bc49e039a025c2f6e905fe5c538303d85e17805cbaef2"} Jun 13 05:29:34.219780 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:34.219755 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcpq6_cb88a316-bf0f-48a9-95b8-de9140c6f414/init-textfile/0.log" Jun 13 05:29:34.421115 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:34.421085 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcpq6_cb88a316-bf0f-48a9-95b8-de9140c6f414/node-exporter/0.log" Jun 13 05:29:34.596509 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:34.596479 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:29:34.598894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:34.598867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:29:34.599299 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:34.599278 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 05:29:34.621046 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:34.621023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcpq6_cb88a316-bf0f-48a9-95b8-de9140c6f414/kube-rbac-proxy/0.log" Jun 13 05:29:40.219721 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:40.219691 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt2dt_456a212c-6a21-4304-ae5a-9343986e6cd8/dns/0.log" Jun 13 05:29:40.420455 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:40.420422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt2dt_456a212c-6a21-4304-ae5a-9343986e6cd8/kube-rbac-proxy/0.log" Jun 13 05:29:41.025581 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:41.025554 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7lgq_6ddddc73-e38f-48b8-ac72-ece19246ba96/dns-node-resolver/0.log" Jun 13 05:29:41.820295 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:41.820266 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-857b8d564b-zfgfh_f2ea84a0-53ef-460c-bca4-31aa27cf0d4f/registry/0.log" Jun 13 05:29:42.026943 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:42.026913 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-857b8d564b-zfgfh_f2ea84a0-53ef-460c-bca4-31aa27cf0d4f/registry/1.log" Jun 13 05:29:42.423136 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:42.423112 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m982k_f7207946-297b-4717-9bc1-f8881a1fe3de/node-ca/0.log" Jun 13 05:29:43.420483 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:43.420458 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nx8cq_46b4b7f8-1c30-4340-a45d-35d98cbd576a/serve-healthcheck-canary/0.log" Jun 13 05:29:45.713320 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:45.713291 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-857b8d564b-zfgfh" Jun 13 05:29:46.643893 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:46.643860 2566 scope.go:117] "RemoveContainer" containerID="e02d8bc8b0e6dd7f8a0aa2a717b8a46f690951c6712c9f603eaacdc60a976aba" Jun 13 05:29:46.786312 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:46.786275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" event={"ID":"6859a67f-e879-4976-aff1-332aa76eaab1","Type":"ContainerStarted","Data":"8a98601123741823bc64f3462f39ba7bacc4982aa408931c740bd29d25aed58e"} Jun 13 05:29:46.786783 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:46.786520 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:29:46.787919 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:29:46.787899 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc5446f4-6dwz6" Jun 13 05:32:09.528058 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.527977 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl"] Jun 13 05:32:09.530992 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.530976 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.533489 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.533463 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 05:32:09.533642 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.533569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-svnns\"" Jun 13 05:32:09.534518 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.534497 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 05:32:09.540280 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.540258 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl"] Jun 13 05:32:09.649625 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.649594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.649729 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.649632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.649729 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.649689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjm7\" (UniqueName: \"kubernetes.io/projected/13fc986b-322f-4606-b6cf-24be13d8b57c-kube-api-access-fxjm7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.750219 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.750196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjm7\" (UniqueName: \"kubernetes.io/projected/13fc986b-322f-4606-b6cf-24be13d8b57c-kube-api-access-fxjm7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.750359 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.750233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.750359 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.750280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.750582 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.750566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.750642 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.750602 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.758463 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.758447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjm7\" (UniqueName: \"kubernetes.io/projected/13fc986b-322f-4606-b6cf-24be13d8b57c-kube-api-access-fxjm7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.840482 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.840436 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:09.961985 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.961960 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl"] Jun 13 05:32:09.964383 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:32:09.964355 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fc986b_322f_4606_b6cf_24be13d8b57c.slice/crio-6e434667fabc14076f1ca28a7c420ba5b32b54e1ed42720b21c6cd5bce5024c0 WatchSource:0}: Error finding container 6e434667fabc14076f1ca28a7c420ba5b32b54e1ed42720b21c6cd5bce5024c0: Status 404 returned error can't find the container with id 6e434667fabc14076f1ca28a7c420ba5b32b54e1ed42720b21c6cd5bce5024c0 Jun 13 05:32:09.966335 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:09.966319 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:32:10.248306 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:10.248223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" event={"ID":"13fc986b-322f-4606-b6cf-24be13d8b57c","Type":"ContainerStarted","Data":"6e434667fabc14076f1ca28a7c420ba5b32b54e1ed42720b21c6cd5bce5024c0"} Jun 13 05:32:17.274313 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:17.274281 2566 generic.go:356] "Generic (PLEG): container finished" podID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerID="109f443d80e9ebaa9228f1b8277d96c964d3f10cdd84228d650b0bab6a2dc758" exitCode=0 Jun 13 05:32:17.274681 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:17.274346 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" event={"ID":"13fc986b-322f-4606-b6cf-24be13d8b57c","Type":"ContainerDied","Data":"109f443d80e9ebaa9228f1b8277d96c964d3f10cdd84228d650b0bab6a2dc758"} Jun 13 05:32:19.282758 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:19.282726 2566 generic.go:356] "Generic (PLEG): container finished" podID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerID="1b242b1d59d855fea105a26f5472c4ee29c56b13c399fa49e306ca105fbbc70c" exitCode=0 Jun 13 05:32:19.283047 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:19.282773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" event={"ID":"13fc986b-322f-4606-b6cf-24be13d8b57c","Type":"ContainerDied","Data":"1b242b1d59d855fea105a26f5472c4ee29c56b13c399fa49e306ca105fbbc70c"} Jun 13 05:32:27.311712 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:27.311677 2566 generic.go:356] "Generic (PLEG): container finished" podID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerID="6b22c0f93e75bc86727d083681fccf7da38e217a85e315d9012c14276cc32e27" exitCode=0 Jun 13 05:32:27.312100 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:27.311730 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" event={"ID":"13fc986b-322f-4606-b6cf-24be13d8b57c","Type":"ContainerDied","Data":"6b22c0f93e75bc86727d083681fccf7da38e217a85e315d9012c14276cc32e27"} Jun 13 05:32:28.434509 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.434481 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:28.493253 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.493211 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-util\") pod \"13fc986b-322f-4606-b6cf-24be13d8b57c\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " Jun 13 05:32:28.493382 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.493291 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-bundle\") pod \"13fc986b-322f-4606-b6cf-24be13d8b57c\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " Jun 13 05:32:28.493382 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.493356 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxjm7\" (UniqueName: \"kubernetes.io/projected/13fc986b-322f-4606-b6cf-24be13d8b57c-kube-api-access-fxjm7\") pod \"13fc986b-322f-4606-b6cf-24be13d8b57c\" (UID: \"13fc986b-322f-4606-b6cf-24be13d8b57c\") " Jun 13 05:32:28.493742 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.493717 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-bundle" (OuterVolumeSpecName: "bundle") pod "13fc986b-322f-4606-b6cf-24be13d8b57c" (UID: "13fc986b-322f-4606-b6cf-24be13d8b57c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:32:28.495541 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.495512 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13fc986b-322f-4606-b6cf-24be13d8b57c-kube-api-access-fxjm7" (OuterVolumeSpecName: "kube-api-access-fxjm7") pod "13fc986b-322f-4606-b6cf-24be13d8b57c" (UID: "13fc986b-322f-4606-b6cf-24be13d8b57c"). InnerVolumeSpecName "kube-api-access-fxjm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:32:28.497954 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.497933 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-util" (OuterVolumeSpecName: "util") pod "13fc986b-322f-4606-b6cf-24be13d8b57c" (UID: "13fc986b-322f-4606-b6cf-24be13d8b57c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:32:28.594517 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.594462 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxjm7\" (UniqueName: \"kubernetes.io/projected/13fc986b-322f-4606-b6cf-24be13d8b57c-kube-api-access-fxjm7\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:32:28.594517 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.594482 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-util\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:32:28.594517 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:28.594492 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13fc986b-322f-4606-b6cf-24be13d8b57c-bundle\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:32:29.320899 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:29.320863 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" event={"ID":"13fc986b-322f-4606-b6cf-24be13d8b57c","Type":"ContainerDied","Data":"6e434667fabc14076f1ca28a7c420ba5b32b54e1ed42720b21c6cd5bce5024c0"} Jun 13 05:32:29.320899 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:29.320886 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dfnl" Jun 13 05:32:29.321098 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:29.320911 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e434667fabc14076f1ca28a7c420ba5b32b54e1ed42720b21c6cd5bce5024c0" Jun 13 05:32:39.223762 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.223722 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2"] Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.223982 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="extract" Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.223994 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="extract" Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.224006 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="util" Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.224012 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="util" Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.224021 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="pull" Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.224026 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="pull" Jun 13 05:32:39.224201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.224065 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="13fc986b-322f-4606-b6cf-24be13d8b57c" containerName="extract" Jun 13 05:32:39.228427 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.228405 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.230973 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.230951 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 05:32:39.232070 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.232048 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 05:32:39.232168 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.232048 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-svnns\"" Jun 13 05:32:39.234650 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.234613 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2"] Jun 13 05:32:39.364990 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.364957 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdbdj\" (UniqueName: \"kubernetes.io/projected/a8a75d99-1205-4895-b3f4-43813ac7582e-kube-api-access-qdbdj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.365163 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.364997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.365163 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.365065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.466250 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.466219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.466379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.466316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdbdj\" (UniqueName: \"kubernetes.io/projected/a8a75d99-1205-4895-b3f4-43813ac7582e-kube-api-access-qdbdj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.466379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.466356 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.466688 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.466665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.466688 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.466679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.474930 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.474879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdbdj\" (UniqueName: \"kubernetes.io/projected/a8a75d99-1205-4895-b3f4-43813ac7582e-kube-api-access-qdbdj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.538835 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.538802 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:39.659967 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:39.659943 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2"] Jun 13 05:32:39.662281 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:32:39.662254 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a75d99_1205_4895_b3f4_43813ac7582e.slice/crio-200e89326ac388c8ef3415d9632702d2c8abe1d247194283f06c36701518ed0a WatchSource:0}: Error finding container 200e89326ac388c8ef3415d9632702d2c8abe1d247194283f06c36701518ed0a: Status 404 returned error can't find the container with id 200e89326ac388c8ef3415d9632702d2c8abe1d247194283f06c36701518ed0a Jun 13 05:32:40.358456 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:40.358421 2566 generic.go:356] "Generic (PLEG): container finished" podID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerID="69da5cb3a05ca9bbd453bf5b4e6b851e8f1554eaf9c94abed474a050a7020812" exitCode=0 Jun 13 05:32:40.358865 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:40.358511 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" event={"ID":"a8a75d99-1205-4895-b3f4-43813ac7582e","Type":"ContainerDied","Data":"69da5cb3a05ca9bbd453bf5b4e6b851e8f1554eaf9c94abed474a050a7020812"} Jun 13 05:32:40.358865 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:40.358593 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" event={"ID":"a8a75d99-1205-4895-b3f4-43813ac7582e","Type":"ContainerStarted","Data":"200e89326ac388c8ef3415d9632702d2c8abe1d247194283f06c36701518ed0a"} Jun 13 05:32:41.364157 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:41.364120 2566 generic.go:356] "Generic (PLEG): container finished" podID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerID="7c1e7154eb9146bab2f8af1335c61c0121ae4834b3925f094e5cb8559799d41d" exitCode=0 Jun 13 05:32:41.364599 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:41.364200 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" event={"ID":"a8a75d99-1205-4895-b3f4-43813ac7582e","Type":"ContainerDied","Data":"7c1e7154eb9146bab2f8af1335c61c0121ae4834b3925f094e5cb8559799d41d"} Jun 13 05:32:42.369873 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:42.369836 2566 generic.go:356] "Generic (PLEG): container finished" podID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerID="eb6099a6beb6b5a7595ca7ff9ed3716fb421258ec971d3936d19dad908f0614f" exitCode=0 Jun 13 05:32:42.370264 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:42.369920 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" event={"ID":"a8a75d99-1205-4895-b3f4-43813ac7582e","Type":"ContainerDied","Data":"eb6099a6beb6b5a7595ca7ff9ed3716fb421258ec971d3936d19dad908f0614f"} Jun 13 05:32:43.491188 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.491161 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:43.596404 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.596362 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdbdj\" (UniqueName: \"kubernetes.io/projected/a8a75d99-1205-4895-b3f4-43813ac7582e-kube-api-access-qdbdj\") pod \"a8a75d99-1205-4895-b3f4-43813ac7582e\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " Jun 13 05:32:43.596404 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.596413 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-bundle\") pod \"a8a75d99-1205-4895-b3f4-43813ac7582e\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " Jun 13 05:32:43.596589 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.596455 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-util\") pod \"a8a75d99-1205-4895-b3f4-43813ac7582e\" (UID: \"a8a75d99-1205-4895-b3f4-43813ac7582e\") " Jun 13 05:32:43.597075 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.597046 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-bundle" (OuterVolumeSpecName: "bundle") pod "a8a75d99-1205-4895-b3f4-43813ac7582e" (UID: "a8a75d99-1205-4895-b3f4-43813ac7582e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:32:43.598462 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.598434 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a75d99-1205-4895-b3f4-43813ac7582e-kube-api-access-qdbdj" (OuterVolumeSpecName: "kube-api-access-qdbdj") pod "a8a75d99-1205-4895-b3f4-43813ac7582e" (UID: "a8a75d99-1205-4895-b3f4-43813ac7582e"). InnerVolumeSpecName "kube-api-access-qdbdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:32:43.601972 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.601938 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-util" (OuterVolumeSpecName: "util") pod "a8a75d99-1205-4895-b3f4-43813ac7582e" (UID: "a8a75d99-1205-4895-b3f4-43813ac7582e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:32:43.697089 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.697031 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-bundle\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:32:43.697089 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.697054 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8a75d99-1205-4895-b3f4-43813ac7582e-util\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:32:43.697089 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:43.697065 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdbdj\" (UniqueName: \"kubernetes.io/projected/a8a75d99-1205-4895-b3f4-43813ac7582e-kube-api-access-qdbdj\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:32:44.379321 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:44.379284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" event={"ID":"a8a75d99-1205-4895-b3f4-43813ac7582e","Type":"ContainerDied","Data":"200e89326ac388c8ef3415d9632702d2c8abe1d247194283f06c36701518ed0a"} Jun 13 05:32:44.379490 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:44.379343 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="200e89326ac388c8ef3415d9632702d2c8abe1d247194283f06c36701518ed0a" Jun 13 05:32:44.379490 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:44.379300 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5nfr2" Jun 13 05:32:55.908912 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.908880 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f"] Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909102 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="util" Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909113 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="util" Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909125 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="extract" Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909131 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="extract" Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909143 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="pull" Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909149 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="pull" Jun 13 05:32:55.909336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.909187 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a75d99-1205-4895-b3f4-43813ac7582e" containerName="extract" Jun 13 05:32:55.910965 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.910948 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:55.913547 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.913519 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 05:32:55.913547 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.913519 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 05:32:55.913747 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.913562 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 05:32:55.913747 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.913613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 05:32:55.913747 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.913544 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tl4cq\"" Jun 13 05:32:55.922488 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:55.922469 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f"] Jun 13 05:32:56.082037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.082002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f32f0884-10b0-42cf-a195-b13e74eab96b-manifests\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.082037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.082035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f32f0884-10b0-42cf-a195-b13e74eab96b-tmp\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.082282 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.082063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f32f0884-10b0-42cf-a195-b13e74eab96b-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.082282 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.082092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f32f0884-10b0-42cf-a195-b13e74eab96b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.082282 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.082114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w4qr\" (UniqueName: \"kubernetes.io/projected/f32f0884-10b0-42cf-a195-b13e74eab96b-kube-api-access-6w4qr\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.183514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.183430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f32f0884-10b0-42cf-a195-b13e74eab96b-manifests\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.183514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.183462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f32f0884-10b0-42cf-a195-b13e74eab96b-tmp\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.183514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.183482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f32f0884-10b0-42cf-a195-b13e74eab96b-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.183514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.183507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f32f0884-10b0-42cf-a195-b13e74eab96b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.183764 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.183541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w4qr\" (UniqueName: \"kubernetes.io/projected/f32f0884-10b0-42cf-a195-b13e74eab96b-kube-api-access-6w4qr\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.183900 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.183861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f32f0884-10b0-42cf-a195-b13e74eab96b-manifests\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.185788 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.185766 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f32f0884-10b0-42cf-a195-b13e74eab96b-tmp\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.185921 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.185908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f32f0884-10b0-42cf-a195-b13e74eab96b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.185996 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.185977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f32f0884-10b0-42cf-a195-b13e74eab96b-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.191412 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.191380 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w4qr\" (UniqueName: \"kubernetes.io/projected/f32f0884-10b0-42cf-a195-b13e74eab96b-kube-api-access-6w4qr\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-7g55f\" (UID: \"f32f0884-10b0-42cf-a195-b13e74eab96b\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.221208 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.221185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:32:56.356548 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.356514 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f"] Jun 13 05:32:56.359982 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:32:56.359954 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32f0884_10b0_42cf_a195_b13e74eab96b.slice/crio-2924af6ba255dec084e9d89c162ac79bde97ba1a28983fab7c00e21636186d30 WatchSource:0}: Error finding container 2924af6ba255dec084e9d89c162ac79bde97ba1a28983fab7c00e21636186d30: Status 404 returned error can't find the container with id 2924af6ba255dec084e9d89c162ac79bde97ba1a28983fab7c00e21636186d30 Jun 13 05:32:56.423571 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:32:56.423537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" event={"ID":"f32f0884-10b0-42cf-a195-b13e74eab96b","Type":"ContainerStarted","Data":"2924af6ba255dec084e9d89c162ac79bde97ba1a28983fab7c00e21636186d30"} Jun 13 05:33:00.441002 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:00.440964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" event={"ID":"f32f0884-10b0-42cf-a195-b13e74eab96b","Type":"ContainerStarted","Data":"f56a68c9a8285aadecf0714d8834b417f253295937231e5823de54bbb6d5a445"} Jun 13 05:33:01.445967 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:01.445935 2566 generic.go:356] "Generic (PLEG): container finished" podID="f32f0884-10b0-42cf-a195-b13e74eab96b" containerID="f56a68c9a8285aadecf0714d8834b417f253295937231e5823de54bbb6d5a445" exitCode=0 Jun 13 05:33:01.446375 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:01.445988 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" event={"ID":"f32f0884-10b0-42cf-a195-b13e74eab96b","Type":"ContainerDied","Data":"f56a68c9a8285aadecf0714d8834b417f253295937231e5823de54bbb6d5a445"} Jun 13 05:33:02.451680 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:02.451647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" event={"ID":"f32f0884-10b0-42cf-a195-b13e74eab96b","Type":"ContainerStarted","Data":"fd04a04171827e2b2b0be3f82b83add15b6ee47a42ffdf488b8ac9820d6e0a8d"} Jun 13 05:33:02.452069 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:02.451759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:33:02.472712 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:02.472672 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" podStartSLOduration=3.043231872 podStartE2EDuration="7.472659365s" totalImagesPullingTime="3.437141657s" totalInitContainerRuntime="992.285836ms" isStatefulPod=false podCreationTimestamp="2026-06-13 05:32:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:02.471230332 +0000 UTC m=+508.281203000" watchObservedRunningTime="2026-06-13 05:33:02.472659365 +0000 UTC m=+508.282632031" Jun 13 05:33:13.458232 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:13.458201 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-7g55f" Jun 13 05:33:15.545596 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.545560 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-666d479cbf-l55qg"] Jun 13 05:33:15.550322 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.550302 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.552893 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.552870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 05:33:15.553008 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.552896 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 05:33:15.553938 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.553921 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 05:33:15.554044 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.553924 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 05:33:15.554044 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.553995 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tzh8z\"" Jun 13 05:33:15.559645 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.559620 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-666d479cbf-l55qg"] Jun 13 05:33:15.573855 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.573829 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-f49sv"] Jun 13 05:33:15.575894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.575876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.578201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.578186 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 13 05:33:15.578355 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.578333 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jqz6r\"" Jun 13 05:33:15.589632 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.589610 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-f49sv"] Jun 13 05:33:15.720292 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.720263 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d8627a-90ab-4936-a4ed-6e67016c52de-tls-certs\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.720447 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.720303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcmj\" (UniqueName: \"kubernetes.io/projected/3cee15ff-2051-4e26-85a9-11440e2d575d-kube-api-access-cgcmj\") pod \"odh-model-controller-6dc94f689f-f49sv\" (UID: \"3cee15ff-2051-4e26-85a9-11440e2d575d\") " pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.720447 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.720369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d8627a-90ab-4936-a4ed-6e67016c52de-tmp\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.720523 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.720446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d566l\" (UniqueName: \"kubernetes.io/projected/29d8627a-90ab-4936-a4ed-6e67016c52de-kube-api-access-d566l\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.720523 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.720475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cee15ff-2051-4e26-85a9-11440e2d575d-cert\") pod \"odh-model-controller-6dc94f689f-f49sv\" (UID: \"3cee15ff-2051-4e26-85a9-11440e2d575d\") " pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.821473 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.821400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d566l\" (UniqueName: \"kubernetes.io/projected/29d8627a-90ab-4936-a4ed-6e67016c52de-kube-api-access-d566l\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.821473 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.821431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cee15ff-2051-4e26-85a9-11440e2d575d-cert\") pod \"odh-model-controller-6dc94f689f-f49sv\" (UID: \"3cee15ff-2051-4e26-85a9-11440e2d575d\") " pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.821473 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.821452 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d8627a-90ab-4936-a4ed-6e67016c52de-tls-certs\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.821473 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.821474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcmj\" (UniqueName: \"kubernetes.io/projected/3cee15ff-2051-4e26-85a9-11440e2d575d-kube-api-access-cgcmj\") pod \"odh-model-controller-6dc94f689f-f49sv\" (UID: \"3cee15ff-2051-4e26-85a9-11440e2d575d\") " pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.821779 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.821499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d8627a-90ab-4936-a4ed-6e67016c52de-tmp\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.823761 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.823732 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d8627a-90ab-4936-a4ed-6e67016c52de-tmp\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.823884 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.823808 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d8627a-90ab-4936-a4ed-6e67016c52de-tls-certs\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.823942 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.823915 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cee15ff-2051-4e26-85a9-11440e2d575d-cert\") pod \"odh-model-controller-6dc94f689f-f49sv\" (UID: \"3cee15ff-2051-4e26-85a9-11440e2d575d\") " pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.832900 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.832873 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcmj\" (UniqueName: \"kubernetes.io/projected/3cee15ff-2051-4e26-85a9-11440e2d575d-kube-api-access-cgcmj\") pod \"odh-model-controller-6dc94f689f-f49sv\" (UID: \"3cee15ff-2051-4e26-85a9-11440e2d575d\") " pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:15.833010 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.832910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d566l\" (UniqueName: \"kubernetes.io/projected/29d8627a-90ab-4936-a4ed-6e67016c52de-kube-api-access-d566l\") pod \"kube-auth-proxy-666d479cbf-l55qg\" (UID: \"29d8627a-90ab-4936-a4ed-6e67016c52de\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.860702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.860680 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" Jun 13 05:33:15.885605 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:15.885576 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:16.023880 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.023720 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-666d479cbf-l55qg"] Jun 13 05:33:16.027386 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:16.027359 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d8627a_90ab_4936_a4ed_6e67016c52de.slice/crio-06259a472ef112e471d1ba63614438d4f2962cf5ac8de5b3ea49db94a94603ef WatchSource:0}: Error finding container 06259a472ef112e471d1ba63614438d4f2962cf5ac8de5b3ea49db94a94603ef: Status 404 returned error can't find the container with id 06259a472ef112e471d1ba63614438d4f2962cf5ac8de5b3ea49db94a94603ef Jun 13 05:33:16.041017 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.040993 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-f49sv"] Jun 13 05:33:16.043731 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:16.043694 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cee15ff_2051_4e26_85a9_11440e2d575d.slice/crio-0ed38e6af983536801a23986a78ca937978650747e80a5b05d48f0b2d4d77e8d WatchSource:0}: Error finding container 0ed38e6af983536801a23986a78ca937978650747e80a5b05d48f0b2d4d77e8d: Status 404 returned error can't find the container with id 0ed38e6af983536801a23986a78ca937978650747e80a5b05d48f0b2d4d77e8d Jun 13 05:33:16.099617 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.099548 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-82hqq"] Jun 13 05:33:16.102199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.102182 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.104527 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.104507 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 13 05:33:16.113498 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.113477 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-82hqq"] Jun 13 05:33:16.223772 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.223744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e65c22-e030-45af-833e-95e84125fdfd-tls-certs\") pod \"model-serving-api-5dd488fc48-82hqq\" (UID: \"13e65c22-e030-45af-833e-95e84125fdfd\") " pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.223941 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.223790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs2vz\" (UniqueName: \"kubernetes.io/projected/13e65c22-e030-45af-833e-95e84125fdfd-kube-api-access-qs2vz\") pod \"model-serving-api-5dd488fc48-82hqq\" (UID: \"13e65c22-e030-45af-833e-95e84125fdfd\") " pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.325093 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.325065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs2vz\" (UniqueName: \"kubernetes.io/projected/13e65c22-e030-45af-833e-95e84125fdfd-kube-api-access-qs2vz\") pod \"model-serving-api-5dd488fc48-82hqq\" (UID: \"13e65c22-e030-45af-833e-95e84125fdfd\") " pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.325262 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.325122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e65c22-e030-45af-833e-95e84125fdfd-tls-certs\") pod \"model-serving-api-5dd488fc48-82hqq\" (UID: \"13e65c22-e030-45af-833e-95e84125fdfd\") " pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.327457 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.327436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e65c22-e030-45af-833e-95e84125fdfd-tls-certs\") pod \"model-serving-api-5dd488fc48-82hqq\" (UID: \"13e65c22-e030-45af-833e-95e84125fdfd\") " pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.340143 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.340123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs2vz\" (UniqueName: \"kubernetes.io/projected/13e65c22-e030-45af-833e-95e84125fdfd-kube-api-access-qs2vz\") pod \"model-serving-api-5dd488fc48-82hqq\" (UID: \"13e65c22-e030-45af-833e-95e84125fdfd\") " pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.412095 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.412023 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:16.504053 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.504014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" event={"ID":"29d8627a-90ab-4936-a4ed-6e67016c52de","Type":"ContainerStarted","Data":"06259a472ef112e471d1ba63614438d4f2962cf5ac8de5b3ea49db94a94603ef"} Jun 13 05:33:16.505255 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.505210 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" event={"ID":"3cee15ff-2051-4e26-85a9-11440e2d575d","Type":"ContainerStarted","Data":"0ed38e6af983536801a23986a78ca937978650747e80a5b05d48f0b2d4d77e8d"} Jun 13 05:33:16.531467 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:16.531439 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-82hqq"] Jun 13 05:33:16.534182 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:16.534157 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e65c22_e030_45af_833e_95e84125fdfd.slice/crio-26b9a9033865646bb2bb8f92f2e5dc2b15919a0cca2d048bec80cf41b926d9e5 WatchSource:0}: Error finding container 26b9a9033865646bb2bb8f92f2e5dc2b15919a0cca2d048bec80cf41b926d9e5: Status 404 returned error can't find the container with id 26b9a9033865646bb2bb8f92f2e5dc2b15919a0cca2d048bec80cf41b926d9e5 Jun 13 05:33:17.515801 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:17.515724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" event={"ID":"13e65c22-e030-45af-833e-95e84125fdfd","Type":"ContainerStarted","Data":"26b9a9033865646bb2bb8f92f2e5dc2b15919a0cca2d048bec80cf41b926d9e5"} Jun 13 05:33:19.373437 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.373402 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8"] Jun 13 05:33:19.381479 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.381448 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.383870 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.383844 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-svnns\"" Jun 13 05:33:19.383870 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.383857 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 05:33:19.384860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.384836 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 05:33:19.388336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.388315 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8"] Jun 13 05:33:19.449877 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.449839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.450057 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.449893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.450057 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.449976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6wqc\" (UniqueName: \"kubernetes.io/projected/33207fd6-7203-4f48-bb9d-36e254bd5b4d-kube-api-access-t6wqc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.551121 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.551084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.551300 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.551131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6wqc\" (UniqueName: \"kubernetes.io/projected/33207fd6-7203-4f48-bb9d-36e254bd5b4d-kube-api-access-t6wqc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.551300 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.551223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.551527 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.551504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.551590 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.551555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.559522 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.559497 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6wqc\" (UniqueName: \"kubernetes.io/projected/33207fd6-7203-4f48-bb9d-36e254bd5b4d-kube-api-access-t6wqc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:19.693462 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:19.693387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:21.038964 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.038897 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8"] Jun 13 05:33:21.042793 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:21.042766 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33207fd6_7203_4f48_bb9d_36e254bd5b4d.slice/crio-ed9562b6d17b3c47a90dca065053e627d971f9d0caa1046db76f9949294e0e06 WatchSource:0}: Error finding container ed9562b6d17b3c47a90dca065053e627d971f9d0caa1046db76f9949294e0e06: Status 404 returned error can't find the container with id ed9562b6d17b3c47a90dca065053e627d971f9d0caa1046db76f9949294e0e06 Jun 13 05:33:21.533361 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.533319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" event={"ID":"13e65c22-e030-45af-833e-95e84125fdfd","Type":"ContainerStarted","Data":"0a96fef4167d2ba47e006d8d106160274abf5313b0df0e910eeff1d8392d06e7"} Jun 13 05:33:21.533554 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.533430 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:21.534784 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.534762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" event={"ID":"29d8627a-90ab-4936-a4ed-6e67016c52de","Type":"ContainerStarted","Data":"54e4204c32ad934dc2ca2f25ef6cbec1542af89b78307bf89c37fd0e1ed57203"} Jun 13 05:33:21.536259 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.536207 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" event={"ID":"3cee15ff-2051-4e26-85a9-11440e2d575d","Type":"ContainerStarted","Data":"7d8d43007a46c4525f5a972d376d40c5e29df683ceed230f86f694ed0d4fcca4"} Jun 13 05:33:21.536363 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.536278 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:21.537689 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.537664 2566 generic.go:356] "Generic (PLEG): container finished" podID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerID="5fd69c0aafc83275df2206a9d7414f1b6d11738b1525c05cce597f6676f321b9" exitCode=0 Jun 13 05:33:21.537772 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.537726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" event={"ID":"33207fd6-7203-4f48-bb9d-36e254bd5b4d","Type":"ContainerDied","Data":"5fd69c0aafc83275df2206a9d7414f1b6d11738b1525c05cce597f6676f321b9"} Jun 13 05:33:21.537772 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.537764 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" event={"ID":"33207fd6-7203-4f48-bb9d-36e254bd5b4d","Type":"ContainerStarted","Data":"ed9562b6d17b3c47a90dca065053e627d971f9d0caa1046db76f9949294e0e06"} Jun 13 05:33:21.552380 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.552338 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" podStartSLOduration=1.182651281 podStartE2EDuration="5.552324709s" totalImagesPullingTime="4.369673428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:21.551452398 +0000 UTC m=+527.361425085" watchObservedRunningTime="2026-06-13 05:33:21.552324709 +0000 UTC m=+527.362297354" Jun 13 05:33:21.567889 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.567851 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-666d479cbf-l55qg" podStartSLOduration=1.695803569 podStartE2EDuration="6.567838354s" totalImagesPullingTime="4.872034785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:21.566591623 +0000 UTC m=+527.376564303" watchObservedRunningTime="2026-06-13 05:33:21.567838354 +0000 UTC m=+527.377811021" Jun 13 05:33:21.581766 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:21.581728 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" podStartSLOduration=1.713986346 podStartE2EDuration="6.581715433s" totalImagesPullingTime="4.867729087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:21.580269426 +0000 UTC m=+527.390242090" watchObservedRunningTime="2026-06-13 05:33:21.581715433 +0000 UTC m=+527.391688104" Jun 13 05:33:22.543707 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:22.543676 2566 generic.go:356] "Generic (PLEG): container finished" podID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerID="12b73877eab9363f2acf1aab3668276738f6dfbe0de532d8e5858fa55b3bbad4" exitCode=0 Jun 13 05:33:22.544119 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:22.543769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" event={"ID":"33207fd6-7203-4f48-bb9d-36e254bd5b4d","Type":"ContainerDied","Data":"12b73877eab9363f2acf1aab3668276738f6dfbe0de532d8e5858fa55b3bbad4"} Jun 13 05:33:23.549583 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:23.549508 2566 generic.go:356] "Generic (PLEG): container finished" podID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerID="5b041ba6158e6e8e59fc4f8af1c45ee7781f7029f79b60c08ecaca9fefede895" exitCode=0 Jun 13 05:33:23.549950 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:23.549589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" event={"ID":"33207fd6-7203-4f48-bb9d-36e254bd5b4d","Type":"ContainerDied","Data":"5b041ba6158e6e8e59fc4f8af1c45ee7781f7029f79b60c08ecaca9fefede895"} Jun 13 05:33:24.673645 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.673619 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:24.690956 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.690932 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-util\") pod \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " Jun 13 05:33:24.691098 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.690966 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-bundle\") pod \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " Jun 13 05:33:24.691098 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.690984 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6wqc\" (UniqueName: \"kubernetes.io/projected/33207fd6-7203-4f48-bb9d-36e254bd5b4d-kube-api-access-t6wqc\") pod \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\" (UID: \"33207fd6-7203-4f48-bb9d-36e254bd5b4d\") " Jun 13 05:33:24.691846 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.691819 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-bundle" (OuterVolumeSpecName: "bundle") pod "33207fd6-7203-4f48-bb9d-36e254bd5b4d" (UID: "33207fd6-7203-4f48-bb9d-36e254bd5b4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:33:24.693134 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.693110 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33207fd6-7203-4f48-bb9d-36e254bd5b4d-kube-api-access-t6wqc" (OuterVolumeSpecName: "kube-api-access-t6wqc") pod "33207fd6-7203-4f48-bb9d-36e254bd5b4d" (UID: "33207fd6-7203-4f48-bb9d-36e254bd5b4d"). InnerVolumeSpecName "kube-api-access-t6wqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:33:24.696861 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.696823 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-util" (OuterVolumeSpecName: "util") pod "33207fd6-7203-4f48-bb9d-36e254bd5b4d" (UID: "33207fd6-7203-4f48-bb9d-36e254bd5b4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:33:24.791460 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.791435 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-util\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:33:24.791610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.791476 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33207fd6-7203-4f48-bb9d-36e254bd5b4d-bundle\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:33:24.791610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:24.791487 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6wqc\" (UniqueName: \"kubernetes.io/projected/33207fd6-7203-4f48-bb9d-36e254bd5b4d-kube-api-access-t6wqc\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:33:25.437284 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437233 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rx7rf"] Jun 13 05:33:25.437513 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437502 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="pull" Jun 13 05:33:25.437570 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437515 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="pull" Jun 13 05:33:25.437570 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437529 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="util" Jun 13 05:33:25.437570 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437534 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="util" Jun 13 05:33:25.437570 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437549 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="extract" Jun 13 05:33:25.437570 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437554 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="extract" Jun 13 05:33:25.437708 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.437594 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33207fd6-7203-4f48-bb9d-36e254bd5b4d" containerName="extract" Jun 13 05:33:25.440320 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.440303 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:25.444107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.444088 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 13 05:33:25.444315 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.444302 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wgp8r\"" Jun 13 05:33:25.469530 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.469457 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92"] Jun 13 05:33:25.472580 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.472563 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rx7rf"] Jun 13 05:33:25.472670 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.472643 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.475751 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.475727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hmqw7\"" Jun 13 05:33:25.475894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.475865 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 13 05:33:25.492709 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.492687 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92"] Jun 13 05:33:25.497498 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.497476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj9nt\" (UniqueName: \"kubernetes.io/projected/e856bd84-850b-4211-a160-977dc3bd8724-kube-api-access-jj9nt\") pod \"llmisvc-controller-manager-864bfd7bc9-tnv92\" (UID: \"e856bd84-850b-4211-a160-977dc3bd8724\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.497600 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.497520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b371441-df5e-42a4-a5aa-3ce5c550e844-cert\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:25.497600 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.497544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e856bd84-850b-4211-a160-977dc3bd8724-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tnv92\" (UID: \"e856bd84-850b-4211-a160-977dc3bd8724\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.497677 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.497634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xt7\" (UniqueName: \"kubernetes.io/projected/9b371441-df5e-42a4-a5aa-3ce5c550e844-kube-api-access-q4xt7\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:25.559685 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.559650 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" event={"ID":"33207fd6-7203-4f48-bb9d-36e254bd5b4d","Type":"ContainerDied","Data":"ed9562b6d17b3c47a90dca065053e627d971f9d0caa1046db76f9949294e0e06"} Jun 13 05:33:25.559685 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.559689 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z7tk8" Jun 13 05:33:25.559888 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.559701 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed9562b6d17b3c47a90dca065053e627d971f9d0caa1046db76f9949294e0e06" Jun 13 05:33:25.598947 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.598920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xt7\" (UniqueName: \"kubernetes.io/projected/9b371441-df5e-42a4-a5aa-3ce5c550e844-kube-api-access-q4xt7\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:25.599081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.598964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj9nt\" (UniqueName: \"kubernetes.io/projected/e856bd84-850b-4211-a160-977dc3bd8724-kube-api-access-jj9nt\") pod \"llmisvc-controller-manager-864bfd7bc9-tnv92\" (UID: \"e856bd84-850b-4211-a160-977dc3bd8724\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.599081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.599005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b371441-df5e-42a4-a5aa-3ce5c550e844-cert\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:25.599081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.599029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e856bd84-850b-4211-a160-977dc3bd8724-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tnv92\" (UID: \"e856bd84-850b-4211-a160-977dc3bd8724\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.599311 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:33:25.599116 2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 13 05:33:25.599311 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:33:25.599168 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b371441-df5e-42a4-a5aa-3ce5c550e844-cert podName:9b371441-df5e-42a4-a5aa-3ce5c550e844 nodeName:}" failed. No retries permitted until 2026-06-13 05:33:26.099147537 +0000 UTC m=+531.909120182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b371441-df5e-42a4-a5aa-3ce5c550e844-cert") pod "kserve-controller-manager-69fc866d76-rx7rf" (UID: "9b371441-df5e-42a4-a5aa-3ce5c550e844") : secret "kserve-webhook-server-cert" not found Jun 13 05:33:25.601643 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.601614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e856bd84-850b-4211-a160-977dc3bd8724-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tnv92\" (UID: \"e856bd84-850b-4211-a160-977dc3bd8724\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.607899 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.607872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj9nt\" (UniqueName: \"kubernetes.io/projected/e856bd84-850b-4211-a160-977dc3bd8724-kube-api-access-jj9nt\") pod \"llmisvc-controller-manager-864bfd7bc9-tnv92\" (UID: \"e856bd84-850b-4211-a160-977dc3bd8724\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.607995 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.607964 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xt7\" (UniqueName: \"kubernetes.io/projected/9b371441-df5e-42a4-a5aa-3ce5c550e844-kube-api-access-q4xt7\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:25.781176 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.781144 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:25.913836 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:25.913808 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92"] Jun 13 05:33:25.916174 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:25.916137 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode856bd84_850b_4211_a160_977dc3bd8724.slice/crio-f053eee0cef94b0fd3d31e5cefb10fee5a62e43f0742c0296f63e23e2f92ec04 WatchSource:0}: Error finding container f053eee0cef94b0fd3d31e5cefb10fee5a62e43f0742c0296f63e23e2f92ec04: Status 404 returned error can't find the container with id f053eee0cef94b0fd3d31e5cefb10fee5a62e43f0742c0296f63e23e2f92ec04 Jun 13 05:33:26.101877 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:26.101788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b371441-df5e-42a4-a5aa-3ce5c550e844-cert\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:26.104175 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:26.104155 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b371441-df5e-42a4-a5aa-3ce5c550e844-cert\") pod \"kserve-controller-manager-69fc866d76-rx7rf\" (UID: \"9b371441-df5e-42a4-a5aa-3ce5c550e844\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:26.349661 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:26.349621 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:26.485789 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:26.485594 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rx7rf"] Jun 13 05:33:26.506600 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:26.506563 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b371441_df5e_42a4_a5aa_3ce5c550e844.slice/crio-d3bc54729a00d73fa0d5f22a6070b4f2057faf89f055dec86e4cff3595080402 WatchSource:0}: Error finding container d3bc54729a00d73fa0d5f22a6070b4f2057faf89f055dec86e4cff3595080402: Status 404 returned error can't find the container with id d3bc54729a00d73fa0d5f22a6070b4f2057faf89f055dec86e4cff3595080402 Jun 13 05:33:26.565636 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:26.565591 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" event={"ID":"e856bd84-850b-4211-a160-977dc3bd8724","Type":"ContainerStarted","Data":"f053eee0cef94b0fd3d31e5cefb10fee5a62e43f0742c0296f63e23e2f92ec04"} Jun 13 05:33:26.567012 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:26.566985 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" event={"ID":"9b371441-df5e-42a4-a5aa-3ce5c550e844","Type":"ContainerStarted","Data":"d3bc54729a00d73fa0d5f22a6070b4f2057faf89f055dec86e4cff3595080402"} Jun 13 05:33:29.583377 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:29.583335 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" event={"ID":"e856bd84-850b-4211-a160-977dc3bd8724","Type":"ContainerStarted","Data":"4eef5af267d4429a7354d77b5f17f0dcb0245338d7bdb39fe0b48502af5e97fd"} Jun 13 05:33:29.583880 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:29.583474 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:33:29.584960 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:29.584931 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" event={"ID":"9b371441-df5e-42a4-a5aa-3ce5c550e844","Type":"ContainerStarted","Data":"2b92835c00ee757f50181cbae675d84f28734f2437f8fb29801d8c5ecca83050"} Jun 13 05:33:29.585073 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:29.584997 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:33:29.599535 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:29.599483 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" podStartSLOduration=1.680476193 podStartE2EDuration="4.599466572s" totalImagesPullingTime="2.918990379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:29.599328171 +0000 UTC m=+535.409300837" watchObservedRunningTime="2026-06-13 05:33:29.599466572 +0000 UTC m=+535.409439240" Jun 13 05:33:29.615842 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:29.615799 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" podStartSLOduration=1.684876763 podStartE2EDuration="4.615787128s" totalImagesPullingTime="2.930910365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:29.615149143 +0000 UTC m=+535.425121847" watchObservedRunningTime="2026-06-13 05:33:29.615787128 +0000 UTC m=+535.425759795" Jun 13 05:33:32.546505 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:32.546473 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-f49sv" Jun 13 05:33:32.548552 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:32.548530 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-82hqq" Jun 13 05:33:35.028841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.028796 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c"] Jun 13 05:33:35.038140 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.038115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.042438 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.042414 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 05:33:35.042588 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.042569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-svnns\"" Jun 13 05:33:35.043597 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.043579 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 05:33:35.050430 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.050400 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c"] Jun 13 05:33:35.074930 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.074904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.075051 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.074950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.075051 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.075010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlhq4\" (UniqueName: \"kubernetes.io/projected/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-kube-api-access-wlhq4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.175597 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.175563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhq4\" (UniqueName: \"kubernetes.io/projected/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-kube-api-access-wlhq4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.175716 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.175646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.175716 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.175688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.176013 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.175987 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.176051 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.176024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.183656 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.183632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhq4\" (UniqueName: \"kubernetes.io/projected/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-kube-api-access-wlhq4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.347790 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.347690 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:35.479062 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.478880 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c"] Jun 13 05:33:35.481654 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:35.481626 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb886f1c6_76d6_4b54_a8c9_ae1ee952aae9.slice/crio-04386dce5baf366fd485e94f447bdebfccf01c78f0a9d2f625c688698d6b303c WatchSource:0}: Error finding container 04386dce5baf366fd485e94f447bdebfccf01c78f0a9d2f625c688698d6b303c: Status 404 returned error can't find the container with id 04386dce5baf366fd485e94f447bdebfccf01c78f0a9d2f625c688698d6b303c Jun 13 05:33:35.614975 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.614899 2566 generic.go:356] "Generic (PLEG): container finished" podID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerID="9da30e227bb4902e6c1bff587f6fb2ad387b550addbf7f10a02d59689c58ca58" exitCode=0 Jun 13 05:33:35.615107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.614974 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" event={"ID":"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9","Type":"ContainerDied","Data":"9da30e227bb4902e6c1bff587f6fb2ad387b550addbf7f10a02d59689c58ca58"} Jun 13 05:33:35.615107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:35.615014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" event={"ID":"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9","Type":"ContainerStarted","Data":"04386dce5baf366fd485e94f447bdebfccf01c78f0a9d2f625c688698d6b303c"} Jun 13 05:33:36.320553 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.320516 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg"] Jun 13 05:33:36.324156 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.324137 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.326963 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.326938 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 13 05:33:36.327097 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.326939 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 13 05:33:36.327097 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.327022 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-kdwlp\"" Jun 13 05:33:36.339293 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.339267 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg"] Jun 13 05:33:36.386327 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.386291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsqwr\" (UniqueName: \"kubernetes.io/projected/1febf861-eb79-4ea8-9432-94e5b237f890-kube-api-access-hsqwr\") pod \"servicemesh-operator3-57f65f65fb-9wtmg\" (UID: \"1febf861-eb79-4ea8-9432-94e5b237f890\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.386509 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.386345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1febf861-eb79-4ea8-9432-94e5b237f890-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9wtmg\" (UID: \"1febf861-eb79-4ea8-9432-94e5b237f890\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.487507 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.487403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsqwr\" (UniqueName: \"kubernetes.io/projected/1febf861-eb79-4ea8-9432-94e5b237f890-kube-api-access-hsqwr\") pod \"servicemesh-operator3-57f65f65fb-9wtmg\" (UID: \"1febf861-eb79-4ea8-9432-94e5b237f890\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.487507 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.487459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1febf861-eb79-4ea8-9432-94e5b237f890-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9wtmg\" (UID: \"1febf861-eb79-4ea8-9432-94e5b237f890\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.489941 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.489921 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1febf861-eb79-4ea8-9432-94e5b237f890-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9wtmg\" (UID: \"1febf861-eb79-4ea8-9432-94e5b237f890\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.496201 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.496179 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsqwr\" (UniqueName: \"kubernetes.io/projected/1febf861-eb79-4ea8-9432-94e5b237f890-kube-api-access-hsqwr\") pod \"servicemesh-operator3-57f65f65fb-9wtmg\" (UID: \"1febf861-eb79-4ea8-9432-94e5b237f890\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.633083 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.633050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:36.774348 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:36.774273 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg"] Jun 13 05:33:36.789825 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:36.789783 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1febf861_eb79_4ea8_9432_94e5b237f890.slice/crio-e099aeda3cdbce13f00a7debb1f097ec915028cf17fc8f2539870929ce450f3e WatchSource:0}: Error finding container e099aeda3cdbce13f00a7debb1f097ec915028cf17fc8f2539870929ce450f3e: Status 404 returned error can't find the container with id e099aeda3cdbce13f00a7debb1f097ec915028cf17fc8f2539870929ce450f3e Jun 13 05:33:37.629104 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:37.629047 2566 generic.go:356] "Generic (PLEG): container finished" podID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerID="51450ac84a742cb8b77098b984279851a300db82e176d5f6fe70ed4737281948" exitCode=0 Jun 13 05:33:37.629595 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:37.629197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" event={"ID":"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9","Type":"ContainerDied","Data":"51450ac84a742cb8b77098b984279851a300db82e176d5f6fe70ed4737281948"} Jun 13 05:33:37.632775 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:37.632715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" event={"ID":"1febf861-eb79-4ea8-9432-94e5b237f890","Type":"ContainerStarted","Data":"e099aeda3cdbce13f00a7debb1f097ec915028cf17fc8f2539870929ce450f3e"} Jun 13 05:33:38.640325 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:38.640289 2566 generic.go:356] "Generic (PLEG): container finished" podID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerID="e15a8b6714f4b02ac0228571199e0534d133ac91c3821ff5a24515975ea3d99a" exitCode=0 Jun 13 05:33:38.640779 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:38.640368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" event={"ID":"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9","Type":"ContainerDied","Data":"e15a8b6714f4b02ac0228571199e0534d133ac91c3821ff5a24515975ea3d99a"} Jun 13 05:33:39.647158 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.647070 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" event={"ID":"1febf861-eb79-4ea8-9432-94e5b237f890","Type":"ContainerStarted","Data":"fc3f1712b1dd7fcce62b68b50b50bb22c06aafeadb0e358e6bd46dc711aee82e"} Jun 13 05:33:39.647537 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.647369 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:39.666506 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.666448 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" podStartSLOduration=1.152556229 podStartE2EDuration="3.666426938s" totalImagesPullingTime="2.513870709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:39.66508451 +0000 UTC m=+545.475057179" watchObservedRunningTime="2026-06-13 05:33:39.666426938 +0000 UTC m=+545.476399606" Jun 13 05:33:39.774799 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.774774 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:39.817861 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.817830 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-util\") pod \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " Jun 13 05:33:39.818010 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.817895 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlhq4\" (UniqueName: \"kubernetes.io/projected/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-kube-api-access-wlhq4\") pod \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " Jun 13 05:33:39.818010 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.817929 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-bundle\") pod \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\" (UID: \"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9\") " Jun 13 05:33:39.818925 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.818894 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-bundle" (OuterVolumeSpecName: "bundle") pod "b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" (UID: "b886f1c6-76d6-4b54-a8c9-ae1ee952aae9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:33:39.820143 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.820109 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-kube-api-access-wlhq4" (OuterVolumeSpecName: "kube-api-access-wlhq4") pod "b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" (UID: "b886f1c6-76d6-4b54-a8c9-ae1ee952aae9"). InnerVolumeSpecName "kube-api-access-wlhq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:33:39.822894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.822872 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-util" (OuterVolumeSpecName: "util") pod "b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" (UID: "b886f1c6-76d6-4b54-a8c9-ae1ee952aae9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:33:39.919082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.918997 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-util\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:33:39.919082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.919024 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlhq4\" (UniqueName: \"kubernetes.io/projected/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-kube-api-access-wlhq4\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:33:39.919082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:39.919035 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b886f1c6-76d6-4b54-a8c9-ae1ee952aae9-bundle\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:33:40.652851 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:40.652816 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" Jun 13 05:33:40.652851 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:40.652833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a25n9c" event={"ID":"b886f1c6-76d6-4b54-a8c9-ae1ee952aae9","Type":"ContainerDied","Data":"04386dce5baf366fd485e94f447bdebfccf01c78f0a9d2f625c688698d6b303c"} Jun 13 05:33:40.653308 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:40.652877 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04386dce5baf366fd485e94f447bdebfccf01c78f0a9d2f625c688698d6b303c" Jun 13 05:33:45.769820 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.769780 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5d74f576d6-w94nn"] Jun 13 05:33:45.770229 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770213 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="util" Jun 13 05:33:45.770283 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770232 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="util" Jun 13 05:33:45.770283 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770273 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="extract" Jun 13 05:33:45.770365 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770283 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="extract" Jun 13 05:33:45.770365 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770304 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="pull" Jun 13 05:33:45.770365 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770312 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="pull" Jun 13 05:33:45.770459 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.770376 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b886f1c6-76d6-4b54-a8c9-ae1ee952aae9" containerName="extract" Jun 13 05:33:45.773818 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.773795 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:45.776449 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.776424 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tscl7\"" Jun 13 05:33:45.776704 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.776687 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 05:33:45.785070 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.785045 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d74f576d6-w94nn"] Jun 13 05:33:45.869302 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.869264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28ctc\" (UniqueName: \"kubernetes.io/projected/888e3659-aa0f-448f-a4be-29db18a91bed-kube-api-access-28ctc\") pod \"dashboard-redirect-5d74f576d6-w94nn\" (UID: \"888e3659-aa0f-448f-a4be-29db18a91bed\") " pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:45.869302 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.869312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/888e3659-aa0f-448f-a4be-29db18a91bed-redirect-config\") pod \"dashboard-redirect-5d74f576d6-w94nn\" (UID: \"888e3659-aa0f-448f-a4be-29db18a91bed\") " pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:45.969725 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.969691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28ctc\" (UniqueName: \"kubernetes.io/projected/888e3659-aa0f-448f-a4be-29db18a91bed-kube-api-access-28ctc\") pod \"dashboard-redirect-5d74f576d6-w94nn\" (UID: \"888e3659-aa0f-448f-a4be-29db18a91bed\") " pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:45.969725 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.969731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/888e3659-aa0f-448f-a4be-29db18a91bed-redirect-config\") pod \"dashboard-redirect-5d74f576d6-w94nn\" (UID: \"888e3659-aa0f-448f-a4be-29db18a91bed\") " pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:45.970510 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.970492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/888e3659-aa0f-448f-a4be-29db18a91bed-redirect-config\") pod \"dashboard-redirect-5d74f576d6-w94nn\" (UID: \"888e3659-aa0f-448f-a4be-29db18a91bed\") " pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:45.986732 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:45.986704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28ctc\" (UniqueName: \"kubernetes.io/projected/888e3659-aa0f-448f-a4be-29db18a91bed-kube-api-access-28ctc\") pod \"dashboard-redirect-5d74f576d6-w94nn\" (UID: \"888e3659-aa0f-448f-a4be-29db18a91bed\") " pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:46.084420 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.084342 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" Jun 13 05:33:46.119116 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.119082 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x"] Jun 13 05:33:46.123527 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.123504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.126233 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.126202 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 13 05:33:46.126359 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.126269 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 05:33:46.126513 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.126499 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zqc4x\"" Jun 13 05:33:46.126568 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.126526 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 13 05:33:46.126690 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.126677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 13 05:33:46.134106 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.134079 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x"] Jun 13 05:33:46.221509 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.221429 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d74f576d6-w94nn"] Jun 13 05:33:46.223643 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:46.223613 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888e3659_aa0f_448f_a4be_29db18a91bed.slice/crio-08f67d52d76df813d317dd4ae0322ec30b8a4e066fa744161be6ef5757dd8c46 WatchSource:0}: Error finding container 08f67d52d76df813d317dd4ae0322ec30b8a4e066fa744161be6ef5757dd8c46: Status 404 returned error can't find the container with id 08f67d52d76df813d317dd4ae0322ec30b8a4e066fa744161be6ef5757dd8c46 Jun 13 05:33:46.272471 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.272586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.272586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.272586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.272740 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.272740 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68zxj\" (UniqueName: \"kubernetes.io/projected/50adff34-e886-49c0-bb54-18e6b4a580bc-kube-api-access-68zxj\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.272740 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.272710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/50adff34-e886-49c0-bb54-18e6b4a580bc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.373969 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/50adff34-e886-49c0-bb54-18e6b4a580bc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374061 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374293 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374365 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374297 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374365 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374510 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.374593 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68zxj\" (UniqueName: \"kubernetes.io/projected/50adff34-e886-49c0-bb54-18e6b4a580bc-kube-api-access-68zxj\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.375023 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.374796 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.376881 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.376857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.376881 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.376857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/50adff34-e886-49c0-bb54-18e6b4a580bc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.377208 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.377190 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.377312 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.377291 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.383107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.383074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68zxj\" (UniqueName: \"kubernetes.io/projected/50adff34-e886-49c0-bb54-18e6b4a580bc-kube-api-access-68zxj\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.383107 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.383095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50adff34-e886-49c0-bb54-18e6b4a580bc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2fq6x\" (UID: \"50adff34-e886-49c0-bb54-18e6b4a580bc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.435111 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.435086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:46.567810 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.567782 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x"] Jun 13 05:33:46.569752 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:33:46.569721 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50adff34_e886_49c0_bb54_18e6b4a580bc.slice/crio-52b174353edb77352fc32c6787dfd06c1d5260bebd2e15dd52ff57da531a3c20 WatchSource:0}: Error finding container 52b174353edb77352fc32c6787dfd06c1d5260bebd2e15dd52ff57da531a3c20: Status 404 returned error can't find the container with id 52b174353edb77352fc32c6787dfd06c1d5260bebd2e15dd52ff57da531a3c20 Jun 13 05:33:46.678206 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.678114 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" event={"ID":"50adff34-e886-49c0-bb54-18e6b4a580bc","Type":"ContainerStarted","Data":"52b174353edb77352fc32c6787dfd06c1d5260bebd2e15dd52ff57da531a3c20"} Jun 13 05:33:46.679301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:46.679271 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" event={"ID":"888e3659-aa0f-448f-a4be-29db18a91bed","Type":"ContainerStarted","Data":"08f67d52d76df813d317dd4ae0322ec30b8a4e066fa744161be6ef5757dd8c46"} Jun 13 05:33:48.692732 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:48.692685 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" event={"ID":"888e3659-aa0f-448f-a4be-29db18a91bed","Type":"ContainerStarted","Data":"e3538e1a0571f0deac22914596c4b19cffebba302176b37df20163d8553c882d"} Jun 13 05:33:48.708540 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:48.708493 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5d74f576d6-w94nn" podStartSLOduration=1.8427346020000002 podStartE2EDuration="3.708476785s" totalImagesPullingTime="1.865742183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:48.707904961 +0000 UTC m=+554.517877628" watchObservedRunningTime="2026-06-13 05:33:48.708476785 +0000 UTC m=+554.518449452" Jun 13 05:33:49.545170 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:49.545123 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 05:33:49.545296 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:49.545209 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 05:33:49.699978 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:49.699939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" event={"ID":"50adff34-e886-49c0-bb54-18e6b4a580bc","Type":"ContainerStarted","Data":"0b7c97cc09efda5f21bf02f740235963c567404c448bec3b0afdb15181b84525"} Jun 13 05:33:49.700393 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:49.700035 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:33:49.720386 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:49.720341 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" podStartSLOduration=0.74719945 podStartE2EDuration="3.720325436s" totalImagesPullingTime="2.973125986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:49.718998177 +0000 UTC m=+555.528970846" watchObservedRunningTime="2026-06-13 05:33:49.720325436 +0000 UTC m=+555.530298102" Jun 13 05:33:50.655076 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:50.655046 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9wtmg" Jun 13 05:33:50.707148 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:50.707114 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-2fq6x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 13 05:33:50.707538 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:50.707174 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" podUID="50adff34-e886-49c0-bb54-18e6b4a580bc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:33:53.706866 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:33:53.706837 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2fq6x" Jun 13 05:34:00.592035 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:00.592001 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnv92" Jun 13 05:34:00.595326 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:00.595300 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-rx7rf" Jun 13 05:34:34.628522 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:34.628492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:34:34.629537 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:34.629511 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:34:52.609736 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.609700 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk"] Jun 13 05:34:52.612746 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.612731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:34:52.615315 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.615291 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 05:34:52.615429 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.615329 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 13 05:34:52.615429 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.615291 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 05:34:52.616355 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.616337 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4ztgl\"" Jun 13 05:34:52.623855 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.623829 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk"] Jun 13 05:34:52.712625 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.712585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvbq6\" (UniqueName: \"kubernetes.io/projected/b98672c9-e912-49dc-b7a2-628150169218-kube-api-access-nvbq6\") pod \"dns-operator-controller-manager-864dd78c4c-c9bxk\" (UID: \"b98672c9-e912-49dc-b7a2-628150169218\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:34:52.813907 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.813875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvbq6\" (UniqueName: \"kubernetes.io/projected/b98672c9-e912-49dc-b7a2-628150169218-kube-api-access-nvbq6\") pod \"dns-operator-controller-manager-864dd78c4c-c9bxk\" (UID: \"b98672c9-e912-49dc-b7a2-628150169218\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:34:52.825871 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.825831 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvbq6\" (UniqueName: \"kubernetes.io/projected/b98672c9-e912-49dc-b7a2-628150169218-kube-api-access-nvbq6\") pod \"dns-operator-controller-manager-864dd78c4c-c9bxk\" (UID: \"b98672c9-e912-49dc-b7a2-628150169218\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:34:52.927984 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:52.927896 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:34:53.062732 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:53.062705 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk"] Jun 13 05:34:53.065661 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:34:53.065630 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98672c9_e912_49dc_b7a2_628150169218.slice/crio-aa3e6583d2c25054e0e4060fdf21ec4136de3cb472db9e83de71bc68c89f7ae4 WatchSource:0}: Error finding container aa3e6583d2c25054e0e4060fdf21ec4136de3cb472db9e83de71bc68c89f7ae4: Status 404 returned error can't find the container with id aa3e6583d2c25054e0e4060fdf21ec4136de3cb472db9e83de71bc68c89f7ae4 Jun 13 05:34:53.973376 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:53.973339 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" event={"ID":"b98672c9-e912-49dc-b7a2-628150169218","Type":"ContainerStarted","Data":"aa3e6583d2c25054e0e4060fdf21ec4136de3cb472db9e83de71bc68c89f7ae4"} Jun 13 05:34:55.984775 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:55.984741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" event={"ID":"b98672c9-e912-49dc-b7a2-628150169218","Type":"ContainerStarted","Data":"de707a6a6df880e144e0cbcfc50398cf4149399596dcc8268dcba1e68967a3d6"} Jun 13 05:34:55.985161 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:55.984819 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:34:56.001712 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.001661 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" podStartSLOduration=1.970481438 podStartE2EDuration="4.00164537s" totalImagesPullingTime="2.031163932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:34:55.999989351 +0000 UTC m=+621.809962044" watchObservedRunningTime="2026-06-13 05:34:56.00164537 +0000 UTC m=+621.811618037" Jun 13 05:34:56.165509 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.165481 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd"] Jun 13 05:34:56.174518 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.174471 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:34:56.177012 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.176989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4lqfm\"" Jun 13 05:34:56.177398 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.177374 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd"] Jun 13 05:34:56.345527 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.345491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6r8r\" (UniqueName: \"kubernetes.io/projected/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91-kube-api-access-h6r8r\") pod \"limitador-operator-controller-manager-859d7b78bd-4ltnd\" (UID: \"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:34:56.446430 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.446396 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6r8r\" (UniqueName: \"kubernetes.io/projected/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91-kube-api-access-h6r8r\") pod \"limitador-operator-controller-manager-859d7b78bd-4ltnd\" (UID: \"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:34:56.456506 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.456477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6r8r\" (UniqueName: \"kubernetes.io/projected/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91-kube-api-access-h6r8r\") pod \"limitador-operator-controller-manager-859d7b78bd-4ltnd\" (UID: \"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:34:56.485350 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.485327 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:34:56.617900 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.617871 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd"] Jun 13 05:34:56.620584 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:34:56.620554 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2aa8e69_42db_4eaa_a1b8_4ff2094a8a91.slice/crio-c18d2f0eb7ff460596ae4a2dca1018b6f490896171e7e9ce7bf6480428305eff WatchSource:0}: Error finding container c18d2f0eb7ff460596ae4a2dca1018b6f490896171e7e9ce7bf6480428305eff: Status 404 returned error can't find the container with id c18d2f0eb7ff460596ae4a2dca1018b6f490896171e7e9ce7bf6480428305eff Jun 13 05:34:56.990509 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:56.990419 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" event={"ID":"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91","Type":"ContainerStarted","Data":"c18d2f0eb7ff460596ae4a2dca1018b6f490896171e7e9ce7bf6480428305eff"} Jun 13 05:34:59.001925 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:59.001837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" event={"ID":"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91","Type":"ContainerStarted","Data":"8d0ea7336561a783184c71f5f44dae28d2420314cb12c21314f0118fd178716e"} Jun 13 05:34:59.001925 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:59.001911 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:34:59.034700 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:34:59.034648 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" podStartSLOduration=1.079879387 podStartE2EDuration="3.034633272s" totalImagesPullingTime="1.954753885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:34:59.03179229 +0000 UTC m=+624.841764958" watchObservedRunningTime="2026-06-13 05:34:59.034633272 +0000 UTC m=+624.844605918" Jun 13 05:35:06.993078 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:06.993047 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9bxk" Jun 13 05:35:10.009050 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:10.009014 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:35:21.870174 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.870136 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd"] Jun 13 05:35:21.870599 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.870401 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" containerName="manager" containerID="cri-o://8d0ea7336561a783184c71f5f44dae28d2420314cb12c21314f0118fd178716e" gracePeriod=2 Jun 13 05:35:21.885211 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.885182 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd"] Jun 13 05:35:21.889052 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:35:21.889020 2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-4ltnd\": pods \"limitador-operator-controller-manager-859d7b78bd-4ltnd\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:35:21.900095 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.900070 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv"] Jun 13 05:35:21.900660 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.900640 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" containerName="manager" Jun 13 05:35:21.900792 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.900778 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" containerName="manager" Jun 13 05:35:21.901004 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.900988 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" containerName="manager" Jun 13 05:35:21.904321 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.904298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:35:21.917979 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.917915 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv"] Jun 13 05:35:21.941356 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:35:21.941318 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4ltnd\" is forbidden: User \"system:node:ip-10-0-130-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-198.ec2.internal' and this object" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:35:21.954215 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:21.954192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c6jh\" (UniqueName: \"kubernetes.io/projected/5a0cadc7-1398-4f5a-ac92-e256297e0679-kube-api-access-5c6jh\") pod \"limitador-operator-controller-manager-859d7b78bd-tsjzv\" (UID: \"5a0cadc7-1398-4f5a-ac92-e256297e0679\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:35:22.054795 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.054763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c6jh\" (UniqueName: \"kubernetes.io/projected/5a0cadc7-1398-4f5a-ac92-e256297e0679-kube-api-access-5c6jh\") pod \"limitador-operator-controller-manager-859d7b78bd-tsjzv\" (UID: \"5a0cadc7-1398-4f5a-ac92-e256297e0679\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:35:22.062805 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.062771 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c6jh\" (UniqueName: \"kubernetes.io/projected/5a0cadc7-1398-4f5a-ac92-e256297e0679-kube-api-access-5c6jh\") pod \"limitador-operator-controller-manager-859d7b78bd-tsjzv\" (UID: \"5a0cadc7-1398-4f5a-ac92-e256297e0679\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:35:22.105306 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.105281 2566 generic.go:356] "Generic (PLEG): container finished" podID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" containerID="8d0ea7336561a783184c71f5f44dae28d2420314cb12c21314f0118fd178716e" exitCode=0 Jun 13 05:35:22.105425 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.105326 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c18d2f0eb7ff460596ae4a2dca1018b6f490896171e7e9ce7bf6480428305eff" Jun 13 05:35:22.107285 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.107270 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:35:22.109780 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:35:22.109760 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4ltnd\" is forbidden: User \"system:node:ip-10-0-130-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-198.ec2.internal' and this object" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:35:22.155979 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.155917 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6r8r\" (UniqueName: \"kubernetes.io/projected/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91-kube-api-access-h6r8r\") pod \"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91\" (UID: \"a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91\") " Jun 13 05:35:22.157905 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.157878 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91-kube-api-access-h6r8r" (OuterVolumeSpecName: "kube-api-access-h6r8r") pod "a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" (UID: "a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91"). InnerVolumeSpecName "kube-api-access-h6r8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:35:22.257006 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.256980 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6r8r\" (UniqueName: \"kubernetes.io/projected/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91-kube-api-access-h6r8r\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:35:22.257839 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.257821 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:35:22.386020 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.385994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv"] Jun 13 05:35:22.387552 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:35:22.387529 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0cadc7_1398_4f5a_ac92_e256297e0679.slice/crio-6956fa0f4a212df1ea3e17bbefafcae969bb3d49992117b51860156c96513bfa WatchSource:0}: Error finding container 6956fa0f4a212df1ea3e17bbefafcae969bb3d49992117b51860156c96513bfa: Status 404 returned error can't find the container with id 6956fa0f4a212df1ea3e17bbefafcae969bb3d49992117b51860156c96513bfa Jun 13 05:35:22.648772 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:22.648737 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91" path="/var/lib/kubelet/pods/a2aa8e69-42db-4eaa-a1b8-4ff2094a8a91/volumes" Jun 13 05:35:23.111878 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:23.111842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" event={"ID":"5a0cadc7-1398-4f5a-ac92-e256297e0679","Type":"ContainerStarted","Data":"85957a93b1a7e3b4d6a188fb1626e1ee021f3f2eb0833547a40985a3d8af0077"} Jun 13 05:35:23.112321 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:23.111897 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" event={"ID":"5a0cadc7-1398-4f5a-ac92-e256297e0679","Type":"ContainerStarted","Data":"6956fa0f4a212df1ea3e17bbefafcae969bb3d49992117b51860156c96513bfa"} Jun 13 05:35:23.112321 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:23.111915 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ltnd" Jun 13 05:35:23.112321 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:23.111929 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:35:23.132672 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:23.132624 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" podStartSLOduration=2.13261055 podStartE2EDuration="2.13261055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:35:23.131023492 +0000 UTC m=+648.940996171" watchObservedRunningTime="2026-06-13 05:35:23.13261055 +0000 UTC m=+648.942583216" Jun 13 05:35:34.119546 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:35:34.119519 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsjzv" Jun 13 05:36:03.470609 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.470573 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:03.473782 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.473764 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.476133 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.476107 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 05:36:03.476229 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.476188 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hpx6f\"" Jun 13 05:36:03.482867 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.482845 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:03.564592 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.564566 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:03.574834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.574811 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbm4\" (UniqueName: \"kubernetes.io/projected/960b033b-b9ee-4be6-a41b-798ec4b4c32d-kube-api-access-2mbm4\") pod \"limitador-limitador-64c94fd64f-j8xwz\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.574950 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.574845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/960b033b-b9ee-4be6-a41b-798ec4b4c32d-config-file\") pod \"limitador-limitador-64c94fd64f-j8xwz\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.675127 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.675100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbm4\" (UniqueName: \"kubernetes.io/projected/960b033b-b9ee-4be6-a41b-798ec4b4c32d-kube-api-access-2mbm4\") pod \"limitador-limitador-64c94fd64f-j8xwz\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.675265 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.675137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/960b033b-b9ee-4be6-a41b-798ec4b4c32d-config-file\") pod \"limitador-limitador-64c94fd64f-j8xwz\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.675786 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.675767 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/960b033b-b9ee-4be6-a41b-798ec4b4c32d-config-file\") pod \"limitador-limitador-64c94fd64f-j8xwz\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.682965 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.682947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbm4\" (UniqueName: \"kubernetes.io/projected/960b033b-b9ee-4be6-a41b-798ec4b4c32d-kube-api-access-2mbm4\") pod \"limitador-limitador-64c94fd64f-j8xwz\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.784536 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.784518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:03.910579 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:03.910549 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:03.913397 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:36:03.913365 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960b033b_b9ee_4be6_a41b_798ec4b4c32d.slice/crio-3f1f9af05014dbfd10e7cd1772ffd71b1faa45e09a30513e38ac8544d346c52f WatchSource:0}: Error finding container 3f1f9af05014dbfd10e7cd1772ffd71b1faa45e09a30513e38ac8544d346c52f: Status 404 returned error can't find the container with id 3f1f9af05014dbfd10e7cd1772ffd71b1faa45e09a30513e38ac8544d346c52f Jun 13 05:36:04.302860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:04.302827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" event={"ID":"960b033b-b9ee-4be6-a41b-798ec4b4c32d","Type":"ContainerStarted","Data":"3f1f9af05014dbfd10e7cd1772ffd71b1faa45e09a30513e38ac8544d346c52f"} Jun 13 05:36:07.320504 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:07.320456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" event={"ID":"960b033b-b9ee-4be6-a41b-798ec4b4c32d","Type":"ContainerStarted","Data":"9952e97f7b1f62822a9b6e106db5d32cb4ac14e367ac41613b39a5c9ffb9ee7e"} Jun 13 05:36:07.320909 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:07.320585 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:07.337487 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:07.337436 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" podStartSLOduration=1.6413538490000001 podStartE2EDuration="4.337421042s" totalImagesPullingTime="2.696067193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:36:07.335582767 +0000 UTC m=+693.145555458" watchObservedRunningTime="2026-06-13 05:36:07.337421042 +0000 UTC m=+693.147393708" Jun 13 05:36:18.326816 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:18.326773 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:20.496499 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:20.496464 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:20.496986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:20.496668 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" podUID="960b033b-b9ee-4be6-a41b-798ec4b4c32d" containerName="limitador" containerID="cri-o://9952e97f7b1f62822a9b6e106db5d32cb4ac14e367ac41613b39a5c9ffb9ee7e" gracePeriod=30 Jun 13 05:36:21.391213 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.391183 2566 generic.go:356] "Generic (PLEG): container finished" podID="960b033b-b9ee-4be6-a41b-798ec4b4c32d" containerID="9952e97f7b1f62822a9b6e106db5d32cb4ac14e367ac41613b39a5c9ffb9ee7e" exitCode=0 Jun 13 05:36:21.391363 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.391270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" event={"ID":"960b033b-b9ee-4be6-a41b-798ec4b4c32d","Type":"ContainerDied","Data":"9952e97f7b1f62822a9b6e106db5d32cb4ac14e367ac41613b39a5c9ffb9ee7e"} Jun 13 05:36:21.439398 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.439378 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:21.509610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.509587 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/960b033b-b9ee-4be6-a41b-798ec4b4c32d-config-file\") pod \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " Jun 13 05:36:21.509888 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.509637 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mbm4\" (UniqueName: \"kubernetes.io/projected/960b033b-b9ee-4be6-a41b-798ec4b4c32d-kube-api-access-2mbm4\") pod \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\" (UID: \"960b033b-b9ee-4be6-a41b-798ec4b4c32d\") " Jun 13 05:36:21.509974 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.509949 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960b033b-b9ee-4be6-a41b-798ec4b4c32d-config-file" (OuterVolumeSpecName: "config-file") pod "960b033b-b9ee-4be6-a41b-798ec4b4c32d" (UID: "960b033b-b9ee-4be6-a41b-798ec4b4c32d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:36:21.511547 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.511526 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960b033b-b9ee-4be6-a41b-798ec4b4c32d-kube-api-access-2mbm4" (OuterVolumeSpecName: "kube-api-access-2mbm4") pod "960b033b-b9ee-4be6-a41b-798ec4b4c32d" (UID: "960b033b-b9ee-4be6-a41b-798ec4b4c32d"). InnerVolumeSpecName "kube-api-access-2mbm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:36:21.610282 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.610215 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mbm4\" (UniqueName: \"kubernetes.io/projected/960b033b-b9ee-4be6-a41b-798ec4b4c32d-kube-api-access-2mbm4\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:36:21.610282 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:21.610236 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/960b033b-b9ee-4be6-a41b-798ec4b4c32d-config-file\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:36:22.397285 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:22.397256 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" Jun 13 05:36:22.397471 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:22.397290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j8xwz" event={"ID":"960b033b-b9ee-4be6-a41b-798ec4b4c32d","Type":"ContainerDied","Data":"3f1f9af05014dbfd10e7cd1772ffd71b1faa45e09a30513e38ac8544d346c52f"} Jun 13 05:36:22.397471 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:22.397369 2566 scope.go:117] "RemoveContainer" containerID="9952e97f7b1f62822a9b6e106db5d32cb4ac14e367ac41613b39a5c9ffb9ee7e" Jun 13 05:36:22.419905 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:22.419880 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:22.423514 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:22.423492 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j8xwz"] Jun 13 05:36:22.648798 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:22.648730 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960b033b-b9ee-4be6-a41b-798ec4b4c32d" path="/var/lib/kubelet/pods/960b033b-b9ee-4be6-a41b-798ec4b4c32d/volumes" Jun 13 05:36:23.844490 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.844391 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-7ddgg"] Jun 13 05:36:23.844977 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.844898 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960b033b-b9ee-4be6-a41b-798ec4b4c32d" containerName="limitador" Jun 13 05:36:23.844977 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.844921 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="960b033b-b9ee-4be6-a41b-798ec4b4c32d" containerName="limitador" Jun 13 05:36:23.845095 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.845021 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="960b033b-b9ee-4be6-a41b-798ec4b4c32d" containerName="limitador" Jun 13 05:36:23.849984 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.849955 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:23.852513 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.852483 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 13 05:36:23.854214 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.854183 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7ddgg"] Jun 13 05:36:23.928995 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.928963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c89aace8-9b5a-4fd4-87a8-056e0e0e7c72-data\") pod \"postgres-69fb4594cf-7ddgg\" (UID: \"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72\") " pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:23.929147 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:23.929004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6t75\" (UniqueName: \"kubernetes.io/projected/c89aace8-9b5a-4fd4-87a8-056e0e0e7c72-kube-api-access-l6t75\") pod \"postgres-69fb4594cf-7ddgg\" (UID: \"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72\") " pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:24.029489 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.029460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c89aace8-9b5a-4fd4-87a8-056e0e0e7c72-data\") pod \"postgres-69fb4594cf-7ddgg\" (UID: \"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72\") " pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:24.029610 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.029499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6t75\" (UniqueName: \"kubernetes.io/projected/c89aace8-9b5a-4fd4-87a8-056e0e0e7c72-kube-api-access-l6t75\") pod \"postgres-69fb4594cf-7ddgg\" (UID: \"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72\") " pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:24.029824 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.029806 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c89aace8-9b5a-4fd4-87a8-056e0e0e7c72-data\") pod \"postgres-69fb4594cf-7ddgg\" (UID: \"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72\") " pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:24.037519 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.037494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6t75\" (UniqueName: \"kubernetes.io/projected/c89aace8-9b5a-4fd4-87a8-056e0e0e7c72-kube-api-access-l6t75\") pod \"postgres-69fb4594cf-7ddgg\" (UID: \"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72\") " pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:24.162590 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.162535 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:24.291276 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.291221 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7ddgg"] Jun 13 05:36:24.293192 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:36:24.293150 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc89aace8_9b5a_4fd4_87a8_056e0e0e7c72.slice/crio-f60f598e76fe51bdf4194de0b73cec2548193412bdd8a60a2271cacdb5b3f034 WatchSource:0}: Error finding container f60f598e76fe51bdf4194de0b73cec2548193412bdd8a60a2271cacdb5b3f034: Status 404 returned error can't find the container with id f60f598e76fe51bdf4194de0b73cec2548193412bdd8a60a2271cacdb5b3f034 Jun 13 05:36:24.408723 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:24.408698 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7ddgg" event={"ID":"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72","Type":"ContainerStarted","Data":"f60f598e76fe51bdf4194de0b73cec2548193412bdd8a60a2271cacdb5b3f034"} Jun 13 05:36:26.420118 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:26.420084 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7ddgg" event={"ID":"c89aace8-9b5a-4fd4-87a8-056e0e0e7c72","Type":"ContainerStarted","Data":"f060a15e2c15cb672872156179f5f43aa445e745be40cf9aadbcc3503d68d7a5"} Jun 13 05:36:26.420513 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:26.420184 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:26.436303 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:26.436191 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-7ddgg" podStartSLOduration=1.542769132 podStartE2EDuration="3.43617704s" totalImagesPullingTime="1.893407908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:36:26.435587103 +0000 UTC m=+712.245559772" watchObservedRunningTime="2026-06-13 05:36:26.43617704 +0000 UTC m=+712.246149753" Jun 13 05:36:32.462112 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:32.462077 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-7ddgg" Jun 13 05:36:33.806364 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.806333 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv"] Jun 13 05:36:33.812740 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.812713 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:33.815517 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.815487 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 05:36:33.816192 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.816168 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 05:36:33.816299 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.816276 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-svnns\"" Jun 13 05:36:33.817110 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.817085 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv"] Jun 13 05:36:33.904524 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.904500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h775z\" (UniqueName: \"kubernetes.io/projected/145c4564-793b-4d38-923a-7331abac966a-kube-api-access-h775z\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:33.904626 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.904531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:33.904626 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:33.904551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.005550 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.005528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h775z\" (UniqueName: \"kubernetes.io/projected/145c4564-793b-4d38-923a-7331abac966a-kube-api-access-h775z\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.005643 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.005565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.005643 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.005585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.005886 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.005869 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.005928 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.005903 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.013652 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.013627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h775z\" (UniqueName: \"kubernetes.io/projected/145c4564-793b-4d38-923a-7331abac966a-kube-api-access-h775z\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.122860 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.122809 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:34.251298 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.251273 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv"] Jun 13 05:36:34.253376 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:36:34.253348 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145c4564_793b_4d38_923a_7331abac966a.slice/crio-ea81a0348fbf107bdb1f065980d9637ac4a8f531f3334c95f55a651061b18d9d WatchSource:0}: Error finding container ea81a0348fbf107bdb1f065980d9637ac4a8f531f3334c95f55a651061b18d9d: Status 404 returned error can't find the container with id ea81a0348fbf107bdb1f065980d9637ac4a8f531f3334c95f55a651061b18d9d Jun 13 05:36:34.459718 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.459645 2566 generic.go:356] "Generic (PLEG): container finished" podID="145c4564-793b-4d38-923a-7331abac966a" containerID="cddbdda2e110484eca44bf0dbe2ed3cacd1057a5b6f94bfc34fd0fefcd161a92" exitCode=0 Jun 13 05:36:34.459829 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.459733 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" event={"ID":"145c4564-793b-4d38-923a-7331abac966a","Type":"ContainerDied","Data":"cddbdda2e110484eca44bf0dbe2ed3cacd1057a5b6f94bfc34fd0fefcd161a92"} Jun 13 05:36:34.459829 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:34.459793 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" event={"ID":"145c4564-793b-4d38-923a-7331abac966a","Type":"ContainerStarted","Data":"ea81a0348fbf107bdb1f065980d9637ac4a8f531f3334c95f55a651061b18d9d"} Jun 13 05:36:35.466291 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:35.466211 2566 generic.go:356] "Generic (PLEG): container finished" podID="145c4564-793b-4d38-923a-7331abac966a" containerID="fed9f696b7fe45052ad8cc2306cb7ff2a3921ece73341a902b715309695accc8" exitCode=0 Jun 13 05:36:35.466613 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:35.466297 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" event={"ID":"145c4564-793b-4d38-923a-7331abac966a","Type":"ContainerDied","Data":"fed9f696b7fe45052ad8cc2306cb7ff2a3921ece73341a902b715309695accc8"} Jun 13 05:36:36.472700 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:36.472667 2566 generic.go:356] "Generic (PLEG): container finished" podID="145c4564-793b-4d38-923a-7331abac966a" containerID="e55031e4cdd38e9d0e77fc4ab98c2677a6167f00d2afdafc4b6739bb6b8564fe" exitCode=0 Jun 13 05:36:36.473070 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:36.472757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" event={"ID":"145c4564-793b-4d38-923a-7331abac966a","Type":"ContainerDied","Data":"e55031e4cdd38e9d0e77fc4ab98c2677a6167f00d2afdafc4b6739bb6b8564fe"} Jun 13 05:36:37.626080 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.626058 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:37.733841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.733785 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h775z\" (UniqueName: \"kubernetes.io/projected/145c4564-793b-4d38-923a-7331abac966a-kube-api-access-h775z\") pod \"145c4564-793b-4d38-923a-7331abac966a\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " Jun 13 05:36:37.733941 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.733845 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-bundle\") pod \"145c4564-793b-4d38-923a-7331abac966a\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " Jun 13 05:36:37.733981 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.733930 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-util\") pod \"145c4564-793b-4d38-923a-7331abac966a\" (UID: \"145c4564-793b-4d38-923a-7331abac966a\") " Jun 13 05:36:37.734360 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.734334 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-bundle" (OuterVolumeSpecName: "bundle") pod "145c4564-793b-4d38-923a-7331abac966a" (UID: "145c4564-793b-4d38-923a-7331abac966a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:36:37.735923 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.735896 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/145c4564-793b-4d38-923a-7331abac966a-kube-api-access-h775z" (OuterVolumeSpecName: "kube-api-access-h775z") pod "145c4564-793b-4d38-923a-7331abac966a" (UID: "145c4564-793b-4d38-923a-7331abac966a"). InnerVolumeSpecName "kube-api-access-h775z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:36:37.739413 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.739390 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-util" (OuterVolumeSpecName: "util") pod "145c4564-793b-4d38-923a-7331abac966a" (UID: "145c4564-793b-4d38-923a-7331abac966a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:36:37.834827 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.834806 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-util\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:36:37.834827 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.834825 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h775z\" (UniqueName: \"kubernetes.io/projected/145c4564-793b-4d38-923a-7331abac966a-kube-api-access-h775z\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:36:37.834947 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:37.834836 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145c4564-793b-4d38-923a-7331abac966a-bundle\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:36:38.483726 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:38.483697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" event={"ID":"145c4564-793b-4d38-923a-7331abac966a","Type":"ContainerDied","Data":"ea81a0348fbf107bdb1f065980d9637ac4a8f531f3334c95f55a651061b18d9d"} Jun 13 05:36:38.483894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:38.483729 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mqqzv" Jun 13 05:36:38.483894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:38.483748 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea81a0348fbf107bdb1f065980d9637ac4a8f531f3334c95f55a651061b18d9d" Jun 13 05:36:57.668319 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668285 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668580 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="extract" Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668591 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="extract" Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668602 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="util" Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668608 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="util" Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668617 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="pull" Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668623 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="pull" Jun 13 05:36:57.668774 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.668670 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="145c4564-793b-4d38-923a-7331abac966a" containerName="extract" Jun 13 05:36:57.670423 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.670405 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 05:36:57.673025 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.672994 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 05:36:57.673310 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.673293 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 05:36:57.674179 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.674165 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jt9mh\"" Jun 13 05:36:57.674230 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.674167 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 05:36:57.679640 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.679617 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:36:57.778088 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.778060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6r2\" (UniqueName: \"kubernetes.io/projected/a878e1f2-d261-4ca1-b81c-0c3befeedb79-kube-api-access-wh6r2\") pod \"maas-keycloak-0\" (UID: \"a878e1f2-d261-4ca1-b81c-0c3befeedb79\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:36:57.879431 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.879398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6r2\" (UniqueName: \"kubernetes.io/projected/a878e1f2-d261-4ca1-b81c-0c3befeedb79-kube-api-access-wh6r2\") pod \"maas-keycloak-0\" (UID: \"a878e1f2-d261-4ca1-b81c-0c3befeedb79\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:36:57.887586 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.887560 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6r2\" (UniqueName: \"kubernetes.io/projected/a878e1f2-d261-4ca1-b81c-0c3befeedb79-kube-api-access-wh6r2\") pod \"maas-keycloak-0\" (UID: \"a878e1f2-d261-4ca1-b81c-0c3befeedb79\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:36:57.980678 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:57.980628 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 05:36:58.104760 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:58.104734 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:36:58.106359 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:36:58.106334 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda878e1f2_d261_4ca1_b81c_0c3befeedb79.slice/crio-8ece6d5e8c88f7a8074473ecd839a424bc306d5444b69bc8ab04fae4de293e03 WatchSource:0}: Error finding container 8ece6d5e8c88f7a8074473ecd839a424bc306d5444b69bc8ab04fae4de293e03: Status 404 returned error can't find the container with id 8ece6d5e8c88f7a8074473ecd839a424bc306d5444b69bc8ab04fae4de293e03 Jun 13 05:36:58.580780 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:36:58.580744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a878e1f2-d261-4ca1-b81c-0c3befeedb79","Type":"ContainerStarted","Data":"8ece6d5e8c88f7a8074473ecd839a424bc306d5444b69bc8ab04fae4de293e03"} Jun 13 05:37:03.614758 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:03.614653 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a878e1f2-d261-4ca1-b81c-0c3befeedb79","Type":"ContainerStarted","Data":"d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8"} Jun 13 05:37:03.635273 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:03.635193 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.40786587 podStartE2EDuration="6.635172679s" totalImagesPullingTime="5.227306809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:37:03.63326397 +0000 UTC m=+749.443236661" watchObservedRunningTime="2026-06-13 05:37:03.635172679 +0000 UTC m=+749.445145348" Jun 13 05:37:03.981273 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:03.981146 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 05:37:03.983048 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:03.983013 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:04.981188 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:04.981131 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:05.982148 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:05.982092 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:06.981165 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:06.981103 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:07.981299 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:07.981228 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 05:37:07.981921 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:07.981886 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:08.981272 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:08.981206 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:09.981443 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:09.981390 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:10.981257 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:10.981193 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:11.981988 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:11.981930 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:12.981652 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:12.981601 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:13.981511 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:13.981455 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:14.981522 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:14.981470 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:15.981099 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:15.981055 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 13 05:37:17.106669 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:17.106611 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 05:37:17.124338 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:17.124288 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:37:27.113182 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:37:27.113148 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 05:38:06.393773 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.393695 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-64b976948f-9ggjc"] Jun 13 05:38:06.396154 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.396130 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.398691 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.398672 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q82fr\"" Jun 13 05:38:06.399690 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.399672 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 05:38:06.407740 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.407714 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64b976948f-9ggjc"] Jun 13 05:38:06.506894 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.506864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rh5\" (UniqueName: \"kubernetes.io/projected/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-kube-api-access-29rh5\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.507014 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.506919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-openshift-service-ca\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.507082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.507020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-maas-api-tls\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.607812 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.607786 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-maas-api-tls\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.607917 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.607819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rh5\" (UniqueName: \"kubernetes.io/projected/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-kube-api-access-29rh5\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.607917 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.607846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-openshift-service-ca\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.608536 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.608515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-openshift-service-ca\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.610423 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.610392 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-maas-api-tls\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.617850 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.617824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rh5\" (UniqueName: \"kubernetes.io/projected/85d7e937-dfd6-4a5f-a9fb-118715daf7fa-kube-api-access-29rh5\") pod \"maas-api-64b976948f-9ggjc\" (UID: \"85d7e937-dfd6-4a5f-a9fb-118715daf7fa\") " pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.706520 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.706459 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:06.845288 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.845256 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64b976948f-9ggjc"] Jun 13 05:38:06.848294 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:38:06.848265 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d7e937_dfd6_4a5f_a9fb_118715daf7fa.slice/crio-eae91df366ec00a999b976ef46ad7c61d73db054fe1bec55efc8bf3cec426f63 WatchSource:0}: Error finding container eae91df366ec00a999b976ef46ad7c61d73db054fe1bec55efc8bf3cec426f63: Status 404 returned error can't find the container with id eae91df366ec00a999b976ef46ad7c61d73db054fe1bec55efc8bf3cec426f63 Jun 13 05:38:06.849922 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.849900 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:38:06.900484 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.900455 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7wlv9"] Jun 13 05:38:06.903463 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.903446 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:38:06.909065 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.909045 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gd762\"" Jun 13 05:38:06.909181 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.909161 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 05:38:06.916856 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.916835 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7wlv9"] Jun 13 05:38:06.968086 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:06.968034 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64b976948f-9ggjc" event={"ID":"85d7e937-dfd6-4a5f-a9fb-118715daf7fa","Type":"ContainerStarted","Data":"eae91df366ec00a999b976ef46ad7c61d73db054fe1bec55efc8bf3cec426f63"} Jun 13 05:38:07.010660 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:07.010639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vmlw\" (UniqueName: \"kubernetes.io/projected/7f098c97-f5d1-46fe-9916-b81f1d804880-kube-api-access-6vmlw\") pod \"payload-processing-699b6cd6c-7wlv9\" (UID: \"7f098c97-f5d1-46fe-9916-b81f1d804880\") " pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:38:07.111327 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:07.111300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vmlw\" (UniqueName: \"kubernetes.io/projected/7f098c97-f5d1-46fe-9916-b81f1d804880-kube-api-access-6vmlw\") pod \"payload-processing-699b6cd6c-7wlv9\" (UID: \"7f098c97-f5d1-46fe-9916-b81f1d804880\") " pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:38:07.122082 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:07.122055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vmlw\" (UniqueName: \"kubernetes.io/projected/7f098c97-f5d1-46fe-9916-b81f1d804880-kube-api-access-6vmlw\") pod \"payload-processing-699b6cd6c-7wlv9\" (UID: \"7f098c97-f5d1-46fe-9916-b81f1d804880\") " pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:38:07.213561 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:07.213536 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:38:07.336154 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:07.336129 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7wlv9"] Jun 13 05:38:07.338176 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:38:07.338140 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f098c97_f5d1_46fe_9916_b81f1d804880.slice/crio-7c4f7d64b12840bbae61a1bd22eed0ce18c7ce25e049ed7cda6b81621af5628e WatchSource:0}: Error finding container 7c4f7d64b12840bbae61a1bd22eed0ce18c7ce25e049ed7cda6b81621af5628e: Status 404 returned error can't find the container with id 7c4f7d64b12840bbae61a1bd22eed0ce18c7ce25e049ed7cda6b81621af5628e Jun 13 05:38:07.976715 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:07.976674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" event={"ID":"7f098c97-f5d1-46fe-9916-b81f1d804880","Type":"ContainerStarted","Data":"7c4f7d64b12840bbae61a1bd22eed0ce18c7ce25e049ed7cda6b81621af5628e"} Jun 13 05:38:08.990133 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:08.990086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64b976948f-9ggjc" event={"ID":"85d7e937-dfd6-4a5f-a9fb-118715daf7fa","Type":"ContainerStarted","Data":"03607c5f0f88d638c6281c5d28a025d78608e3546b32f5a13120965c12d5006b"} Jun 13 05:38:08.990620 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:08.990284 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:09.005940 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:09.005891 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-64b976948f-9ggjc" podStartSLOduration=1.372904023 podStartE2EDuration="3.005872899s" totalImagesPullingTime="1.632968876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:38:09.004716617 +0000 UTC m=+814.814689285" watchObservedRunningTime="2026-06-13 05:38:09.005872899 +0000 UTC m=+814.815845567" Jun 13 05:38:09.995883 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:09.995790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" event={"ID":"7f098c97-f5d1-46fe-9916-b81f1d804880","Type":"ContainerStarted","Data":"c7504e9ef4e3d5c6c92efab1f607d23bb74bf16e195e8d8cffcbc61d57fc5ae7"} Jun 13 05:38:09.996301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:09.995923 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:38:10.011416 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:10.011373 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" podStartSLOduration=1.717956623 podStartE2EDuration="4.01135871s" totalImagesPullingTime="2.293402087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:38:10.010010428 +0000 UTC m=+815.819983086" watchObservedRunningTime="2026-06-13 05:38:10.01135871 +0000 UTC m=+815.821331388" Jun 13 05:38:15.001057 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:15.001023 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-64b976948f-9ggjc" Jun 13 05:38:21.003183 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:38:21.003149 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-7wlv9" Jun 13 05:39:34.665067 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:39:34.664988 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:39:34.666142 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:39:34.666122 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:40:19.267053 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:19.267018 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:40:19.267569 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:19.267199 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" containerID="cri-o://d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8" gracePeriod=30 Jun 13 05:40:20.922663 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:20.922638 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:21.102112 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.102084 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh6r2\" (UniqueName: \"kubernetes.io/projected/a878e1f2-d261-4ca1-b81c-0c3befeedb79-kube-api-access-wh6r2\") pod \"a878e1f2-d261-4ca1-b81c-0c3befeedb79\" (UID: \"a878e1f2-d261-4ca1-b81c-0c3befeedb79\") " Jun 13 05:40:21.104149 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.104119 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a878e1f2-d261-4ca1-b81c-0c3befeedb79-kube-api-access-wh6r2" (OuterVolumeSpecName: "kube-api-access-wh6r2") pod "a878e1f2-d261-4ca1-b81c-0c3befeedb79" (UID: "a878e1f2-d261-4ca1-b81c-0c3befeedb79"). InnerVolumeSpecName "kube-api-access-wh6r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:40:21.203083 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.203051 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh6r2\" (UniqueName: \"kubernetes.io/projected/a878e1f2-d261-4ca1-b81c-0c3befeedb79-kube-api-access-wh6r2\") on node \"ip-10-0-130-198.ec2.internal\" DevicePath \"\"" Jun 13 05:40:21.659098 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.659066 2566 generic.go:356] "Generic (PLEG): container finished" podID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerID="d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8" exitCode=143 Jun 13 05:40:21.659261 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.659111 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:21.659261 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.659167 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a878e1f2-d261-4ca1-b81c-0c3befeedb79","Type":"ContainerDied","Data":"d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8"} Jun 13 05:40:21.659261 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.659222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a878e1f2-d261-4ca1-b81c-0c3befeedb79","Type":"ContainerDied","Data":"8ece6d5e8c88f7a8074473ecd839a424bc306d5444b69bc8ab04fae4de293e03"} Jun 13 05:40:21.659371 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.659269 2566 scope.go:117] "RemoveContainer" containerID="d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8" Jun 13 05:40:21.670451 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.670432 2566 scope.go:117] "RemoveContainer" containerID="d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8" Jun 13 05:40:21.670803 ip-10-0-130-198 kubenswrapper[2566]: E0613 05:40:21.670757 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8\": container with ID starting with d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8 not found: ID does not exist" containerID="d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8" Jun 13 05:40:21.670880 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.670797 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8"} err="failed to get container status \"d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8\": rpc error: code = NotFound desc = could not find container \"d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8\": container with ID starting with d8e2024a603a312099173c10f328f6535747098c1d79c37b21c9179b7315fad8 not found: ID does not exist" Jun 13 05:40:21.680870 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.680845 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:40:21.685913 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.685883 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:40:21.707958 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.707918 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:40:21.708306 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.708292 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" Jun 13 05:40:21.708369 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.708308 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" Jun 13 05:40:21.708411 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.708369 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" containerName="keycloak" Jun 13 05:40:21.712757 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.712742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:21.715424 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.715401 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 05:40:21.715530 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.715431 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 13 05:40:21.715530 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.715455 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jt9mh\"" Jun 13 05:40:21.715530 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.715466 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 05:40:21.715708 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.715559 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 05:40:21.720990 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.720964 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:40:21.907997 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.907966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b954ba92-a388-477d-8e67-984e30232074-test-realms\") pod \"maas-keycloak-0\" (UID: \"b954ba92-a388-477d-8e67-984e30232074\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:21.908135 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:21.908011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smrf\" (UniqueName: \"kubernetes.io/projected/b954ba92-a388-477d-8e67-984e30232074-kube-api-access-6smrf\") pod \"maas-keycloak-0\" (UID: \"b954ba92-a388-477d-8e67-984e30232074\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:22.009506 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.009434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b954ba92-a388-477d-8e67-984e30232074-test-realms\") pod \"maas-keycloak-0\" (UID: \"b954ba92-a388-477d-8e67-984e30232074\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:22.009506 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.009470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smrf\" (UniqueName: \"kubernetes.io/projected/b954ba92-a388-477d-8e67-984e30232074-kube-api-access-6smrf\") pod \"maas-keycloak-0\" (UID: \"b954ba92-a388-477d-8e67-984e30232074\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:22.010220 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.010195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b954ba92-a388-477d-8e67-984e30232074-test-realms\") pod \"maas-keycloak-0\" (UID: \"b954ba92-a388-477d-8e67-984e30232074\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:22.017813 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.017791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smrf\" (UniqueName: \"kubernetes.io/projected/b954ba92-a388-477d-8e67-984e30232074-kube-api-access-6smrf\") pod \"maas-keycloak-0\" (UID: \"b954ba92-a388-477d-8e67-984e30232074\") " pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:22.023744 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.023722 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:22.148869 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.148847 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 05:40:22.150489 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:40:22.150463 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb954ba92_a388_477d_8e67_984e30232074.slice/crio-a2299c4e1592760122522372bed60a671b36ba479ee4b91ef283c191c675cce4 WatchSource:0}: Error finding container a2299c4e1592760122522372bed60a671b36ba479ee4b91ef283c191c675cce4: Status 404 returned error can't find the container with id a2299c4e1592760122522372bed60a671b36ba479ee4b91ef283c191c675cce4 Jun 13 05:40:22.649746 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.649721 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a878e1f2-d261-4ca1-b81c-0c3befeedb79" path="/var/lib/kubelet/pods/a878e1f2-d261-4ca1-b81c-0c3befeedb79/volumes" Jun 13 05:40:22.666854 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.666830 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b954ba92-a388-477d-8e67-984e30232074","Type":"ContainerStarted","Data":"8811c0b0cca1ee4a17dcf042c37ef8a23ecfb6d0c05096c92aab52cf920c53b3"} Jun 13 05:40:22.666963 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.666871 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b954ba92-a388-477d-8e67-984e30232074","Type":"ContainerStarted","Data":"a2299c4e1592760122522372bed60a671b36ba479ee4b91ef283c191c675cce4"} Jun 13 05:40:22.685310 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:22.685268 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.322861574 podStartE2EDuration="1.685237945s" totalImagesPullingTime="362.376371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:40:22.683823354 +0000 UTC m=+948.493796198" watchObservedRunningTime="2026-06-13 05:40:22.685237945 +0000 UTC m=+948.495210615" Jun 13 05:40:23.024931 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:23.024888 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:23.026749 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:23.026711 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:24.024454 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:24.024395 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:25.024414 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:25.024371 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:26.024738 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:26.024682 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:27.024226 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:27.024174 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:28.025212 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:28.025162 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:29.025133 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:29.025084 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:30.024435 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:30.024384 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:31.024847 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:31.024791 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:32.024320 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:32.024279 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:32.024641 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:32.024594 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:33.024608 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:33.024557 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:34.024373 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:34.024326 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:35.024938 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:35.024890 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 13 05:40:36.149574 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:36.149530 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 05:40:36.167017 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:36.166953 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b954ba92-a388-477d-8e67-984e30232074" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:40:46.156041 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:40:46.156008 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 05:41:22.664138 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.664107 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh"] Jun 13 05:41:22.667773 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.667751 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.671368 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.671350 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7k7mn\"" Jun 13 05:41:22.672280 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.672263 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 05:41:22.672370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.672298 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 05:41:22.672370 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.672308 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 13 05:41:22.691326 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.691303 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh"] Jun 13 05:41:22.798112 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.798077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.798273 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.798123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.798273 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.798147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.798273 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.798226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350b50a7-60b6-4a58-aeba-627a416531db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.798428 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.798314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.798428 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.798339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdb8n\" (UniqueName: \"kubernetes.io/projected/350b50a7-60b6-4a58-aeba-627a416531db-kube-api-access-qdb8n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899456 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350b50a7-60b6-4a58-aeba-627a416531db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899571 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899571 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdb8n\" (UniqueName: \"kubernetes.io/projected/350b50a7-60b6-4a58-aeba-627a416531db-kube-api-access-qdb8n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899571 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899710 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899710 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899599 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.899988 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.900148 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.899998 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.900148 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.900043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.901834 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.901814 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350b50a7-60b6-4a58-aeba-627a416531db-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.902103 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.902086 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350b50a7-60b6-4a58-aeba-627a416531db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.907974 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.907952 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdb8n\" (UniqueName: \"kubernetes.io/projected/350b50a7-60b6-4a58-aeba-627a416531db-kube-api-access-qdb8n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh\" (UID: \"350b50a7-60b6-4a58-aeba-627a416531db\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:22.977888 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:22.977838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:41:23.113543 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:23.113515 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh"] Jun 13 05:41:23.115405 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:41:23.115372 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350b50a7_60b6_4a58_aeba_627a416531db.slice/crio-0060f26d088417472c978e242219d1de4c8244376b3f0c2151cd89ea41b8413e WatchSource:0}: Error finding container 0060f26d088417472c978e242219d1de4c8244376b3f0c2151cd89ea41b8413e: Status 404 returned error can't find the container with id 0060f26d088417472c978e242219d1de4c8244376b3f0c2151cd89ea41b8413e Jun 13 05:41:24.016222 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:24.016190 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" event={"ID":"350b50a7-60b6-4a58-aeba-627a416531db","Type":"ContainerStarted","Data":"0060f26d088417472c978e242219d1de4c8244376b3f0c2151cd89ea41b8413e"} Jun 13 05:41:27.043104 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:27.043065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" event={"ID":"350b50a7-60b6-4a58-aeba-627a416531db","Type":"ContainerStarted","Data":"828d273700a4b16be854e6a56686c21f432834e82bdac44f7a9dfa8e4afdb09e"} Jun 13 05:41:34.679986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:34.679956 2566 scope.go:117] "RemoveContainer" containerID="8d0ea7336561a783184c71f5f44dae28d2420314cb12c21314f0118fd178716e" Jun 13 05:41:42.574066 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.574033 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h"] Jun 13 05:41:42.577552 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.577534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.580021 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.579998 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 13 05:41:42.584769 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.584748 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h"] Jun 13 05:41:42.654018 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.653991 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.654138 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.654021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.654138 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.654036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.654138 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.654057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.654138 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.654115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvsk\" (UniqueName: \"kubernetes.io/projected/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-kube-api-access-kdvsk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.654326 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.654144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.754784 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.754759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.754907 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.754790 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.754907 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.754805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.754907 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.754833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.754907 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.754867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvsk\" (UniqueName: \"kubernetes.io/projected/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-kube-api-access-kdvsk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.754907 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.754899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.755187 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.755164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.755341 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.755318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.755411 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.755377 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.757067 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.757049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.757336 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.757319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.762333 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.762306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvsk\" (UniqueName: \"kubernetes.io/projected/f06720f6-6efa-4b04-bacc-adb75eeb5aa1-kube-api-access-kdvsk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h\" (UID: \"f06720f6-6efa-4b04-bacc-adb75eeb5aa1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:42.890465 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:42.890414 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:41:43.016553 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:43.016519 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h"] Jun 13 05:41:43.017901 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:41:43.017874 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06720f6_6efa_4b04_bacc_adb75eeb5aa1.slice/crio-6b56f2ce07dc076388ca87d77d7fa4b9a98d4fd5d44248f697842903da754ff8 WatchSource:0}: Error finding container 6b56f2ce07dc076388ca87d77d7fa4b9a98d4fd5d44248f697842903da754ff8: Status 404 returned error can't find the container with id 6b56f2ce07dc076388ca87d77d7fa4b9a98d4fd5d44248f697842903da754ff8 Jun 13 05:41:43.120820 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:43.120790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" event={"ID":"f06720f6-6efa-4b04-bacc-adb75eeb5aa1","Type":"ContainerStarted","Data":"596e20bbc38595db78d87a30b317232ffdcd58d5b8b5957e4c000de758b9b987"} Jun 13 05:41:43.121026 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:43.120849 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" event={"ID":"f06720f6-6efa-4b04-bacc-adb75eeb5aa1","Type":"ContainerStarted","Data":"6b56f2ce07dc076388ca87d77d7fa4b9a98d4fd5d44248f697842903da754ff8"} Jun 13 05:41:46.069052 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.069020 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp"] Jun 13 05:41:46.084883 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.084855 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp"] Jun 13 05:41:46.085039 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.084944 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.087418 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.087385 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 13 05:41:46.182638 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.182613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.182757 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.182645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.182757 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.182671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ngm\" (UniqueName: \"kubernetes.io/projected/c76ad089-7740-4c6b-b03e-15c45612441e-kube-api-access-c9ngm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.182757 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.182721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.182757 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.182741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.182919 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.182757 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c76ad089-7740-4c6b-b03e-15c45612441e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.283874 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.283850 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.283992 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.283881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c76ad089-7740-4c6b-b03e-15c45612441e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.283992 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.283961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.284064 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.283987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.284133 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.284111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ngm\" (UniqueName: \"kubernetes.io/projected/c76ad089-7740-4c6b-b03e-15c45612441e-kube-api-access-c9ngm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.284186 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.284168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.284332 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.284312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.284405 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.284328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.284470 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.284455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.286312 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.286290 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c76ad089-7740-4c6b-b03e-15c45612441e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.286566 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.286549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c76ad089-7740-4c6b-b03e-15c45612441e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.292192 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.292174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ngm\" (UniqueName: \"kubernetes.io/projected/c76ad089-7740-4c6b-b03e-15c45612441e-kube-api-access-c9ngm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp\" (UID: \"c76ad089-7740-4c6b-b03e-15c45612441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.395548 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.395492 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" Jun 13 05:41:46.523963 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:46.523886 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp"] Jun 13 05:41:46.526146 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:41:46.526036 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76ad089_7740_4c6b_b03e_15c45612441e.slice/crio-67d2c4bf9adfdd27c4e1cdaea7a968bf7ea71f01225faae6b46a7dea9bd4849e WatchSource:0}: Error finding container 67d2c4bf9adfdd27c4e1cdaea7a968bf7ea71f01225faae6b46a7dea9bd4849e: Status 404 returned error can't find the container with id 67d2c4bf9adfdd27c4e1cdaea7a968bf7ea71f01225faae6b46a7dea9bd4849e Jun 13 05:41:47.141847 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:47.141814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" event={"ID":"c76ad089-7740-4c6b-b03e-15c45612441e","Type":"ContainerStarted","Data":"a0dd5e5715a4976e752e475880158fdef609e2f87cfb7d7148242d097e84881f"} Jun 13 05:41:47.142206 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:41:47.141873 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp" event={"ID":"c76ad089-7740-4c6b-b03e-15c45612441e","Type":"ContainerStarted","Data":"67d2c4bf9adfdd27c4e1cdaea7a968bf7ea71f01225faae6b46a7dea9bd4849e"} Jun 13 05:42:06.981657 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:06.981625 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h"] Jun 13 05:42:06.985287 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:06.985262 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:06.987843 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:06.987823 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 13 05:42:06.998754 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:06.998728 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h"] Jun 13 05:42:07.040193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.040161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-495rd\" (UniqueName: \"kubernetes.io/projected/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-kube-api-access-495rd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.040355 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.040198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.040355 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.040297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.040355 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.040315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.040355 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.040336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.040544 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.040359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141493 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141493 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141558 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-495rd\" (UniqueName: \"kubernetes.io/projected/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-kube-api-access-495rd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141596 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141702 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141838 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141714 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.141955 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.141936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.143895 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.143864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.144025 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.144006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.148836 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.148815 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-495rd\" (UniqueName: \"kubernetes.io/projected/e0df05a2-9004-4fd9-bd9c-dd916e14f9b2-kube-api-access-495rd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h\" (UID: \"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.299155 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.299117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:42:07.431757 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:07.431731 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h"] Jun 13 05:42:07.433548 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:42:07.433518 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0df05a2_9004_4fd9_bd9c_dd916e14f9b2.slice/crio-dd2be66b6901b7b9b9497abfd40f03ec8def605153e52f7fc7f1b39b2b00dc0d WatchSource:0}: Error finding container dd2be66b6901b7b9b9497abfd40f03ec8def605153e52f7fc7f1b39b2b00dc0d: Status 404 returned error can't find the container with id dd2be66b6901b7b9b9497abfd40f03ec8def605153e52f7fc7f1b39b2b00dc0d Jun 13 05:42:08.249698 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:08.249658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" event={"ID":"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2","Type":"ContainerStarted","Data":"b49ebcf9168181540c727e5305704c4be9a4718205589ba05a392f4b0620fedc"} Jun 13 05:42:08.250066 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:08.249715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" event={"ID":"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2","Type":"ContainerStarted","Data":"dd2be66b6901b7b9b9497abfd40f03ec8def605153e52f7fc7f1b39b2b00dc0d"} Jun 13 05:42:21.318199 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:21.318163 2566 generic.go:356] "Generic (PLEG): container finished" podID="350b50a7-60b6-4a58-aeba-627a416531db" containerID="828d273700a4b16be854e6a56686c21f432834e82bdac44f7a9dfa8e4afdb09e" exitCode=0 Jun 13 05:42:21.318670 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:21.318236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" event={"ID":"350b50a7-60b6-4a58-aeba-627a416531db","Type":"ContainerDied","Data":"828d273700a4b16be854e6a56686c21f432834e82bdac44f7a9dfa8e4afdb09e"} Jun 13 05:42:23.331618 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:23.331543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" event={"ID":"350b50a7-60b6-4a58-aeba-627a416531db","Type":"ContainerStarted","Data":"8fa159b548b294662e32d24106f5d94cd354e326ea8a22b3438ab291b49ecadb"} Jun 13 05:42:23.348855 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:23.348803 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" podStartSLOduration=3.104584832 podStartE2EDuration="1m1.348787334s" totalImagesPullingTime="4.646833242s" totalInitContainerRuntime="53.59736926s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:41:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:42:23.347934093 +0000 UTC m=+1069.157906773" watchObservedRunningTime="2026-06-13 05:42:23.348787334 +0000 UTC m=+1069.158760001" Jun 13 05:42:32.977988 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:32.977936 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:42:32.978481 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:32.978037 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:42:32.990379 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:32.990360 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:42:33.393630 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:42:33.393601 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh" Jun 13 05:43:01.524075 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:01.524037 2566 generic.go:356] "Generic (PLEG): container finished" podID="e0df05a2-9004-4fd9-bd9c-dd916e14f9b2" containerID="b49ebcf9168181540c727e5305704c4be9a4718205589ba05a392f4b0620fedc" exitCode=0 Jun 13 05:43:01.524075 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:01.524078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" event={"ID":"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2","Type":"ContainerDied","Data":"b49ebcf9168181540c727e5305704c4be9a4718205589ba05a392f4b0620fedc"} Jun 13 05:43:02.531797 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:02.531763 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" event={"ID":"e0df05a2-9004-4fd9-bd9c-dd916e14f9b2","Type":"ContainerStarted","Data":"7caeb1818f516ba2a7075a080b8fff896fcfbf9e7c263e79fa72db1987260863"} Jun 13 05:43:02.549163 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:02.549122 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" podStartSLOduration=3.173682201 podStartE2EDuration="56.549109929s" totalImagesPullingTime="153.945382ms" totalInitContainerRuntime="53.221482346s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:43:02.548426842 +0000 UTC m=+1108.358399514" watchObservedRunningTime="2026-06-13 05:43:02.549109929 +0000 UTC m=+1108.359082595" Jun 13 05:43:07.299463 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:07.299424 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:43:07.299954 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:07.299512 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:43:07.312166 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:07.312140 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:43:07.567902 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:43:07.567833 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h" Jun 13 05:44:18.931111 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:18.931079 2566 generic.go:356] "Generic (PLEG): container finished" podID="f06720f6-6efa-4b04-bacc-adb75eeb5aa1" containerID="596e20bbc38595db78d87a30b317232ffdcd58d5b8b5957e4c000de758b9b987" exitCode=0 Jun 13 05:44:18.931472 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:18.931149 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" event={"ID":"f06720f6-6efa-4b04-bacc-adb75eeb5aa1","Type":"ContainerDied","Data":"596e20bbc38595db78d87a30b317232ffdcd58d5b8b5957e4c000de758b9b987"} Jun 13 05:44:18.931771 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:18.931756 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:44:19.938748 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:19.938711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" event={"ID":"f06720f6-6efa-4b04-bacc-adb75eeb5aa1","Type":"ContainerStarted","Data":"6ed7cab64dbdcdd603bc40941eb69e9401c5ec63957a5daec9bdf94f0c15b2b5"} Jun 13 05:44:19.957304 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:19.957235 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" podStartSLOduration=2.021898854 podStartE2EDuration="2m37.957220432s" totalImagesPullingTime="168.794506ms" totalInitContainerRuntime="2m35.766527072s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:44:19.95571067 +0000 UTC m=+1185.765683336" watchObservedRunningTime="2026-06-13 05:44:19.957220432 +0000 UTC m=+1185.767193097" Jun 13 05:44:22.890926 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:22.890890 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:44:22.891380 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:22.890950 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:44:22.903304 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:22.903282 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:44:22.965748 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:22.965724 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h" Jun 13 05:44:34.702120 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:34.702087 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:44:34.705375 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:44:34.705356 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccnvt_c0985ac6-dfbb-4351-a385-948cf5f06462/ovn-acl-logging/0.log" Jun 13 05:48:42.778295 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:42.778207 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d74f576d6-w94nn_888e3659-aa0f-448f-a4be-29db18a91bed/nginx/0.log" Jun 13 05:48:42.888218 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:42.888176 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-rx7rf_9b371441-df5e-42a4-a5aa-3ce5c550e844/manager/0.log" Jun 13 05:48:43.004259 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:43.004210 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-tnv92_e856bd84-850b-4211-a160-977dc3bd8724/manager/0.log" Jun 13 05:48:43.116311 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:43.116213 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64b976948f-9ggjc_85d7e937-dfd6-4a5f-a9fb-118715daf7fa/maas-api/0.log" Jun 13 05:48:43.456299 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:43.456196 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-82hqq_13e65c22-e030-45af-833e-95e84125fdfd/server/0.log" Jun 13 05:48:43.574141 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:43.574112 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-f49sv_3cee15ff-2051-4e26-85a9-11440e2d575d/manager/0.log" Jun 13 05:48:43.687851 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:43.687828 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-7g55f_f32f0884-10b0-42cf-a195-b13e74eab96b/copy-manifests/0.log" Jun 13 05:48:43.693874 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:43.693852 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-7g55f_f32f0884-10b0-42cf-a195-b13e74eab96b/manager/0.log" Jun 13 05:48:44.050193 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:44.050162 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7ddgg_c89aace8-9b5a-4fd4-87a8-056e0e0e7c72/postgres/0.log" Jun 13 05:48:45.552939 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:45.552911 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c9bxk_b98672c9-e912-49dc-b7a2-628150169218/manager/0.log" Jun 13 05:48:46.120687 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:46.120651 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tsjzv_5a0cadc7-1398-4f5a-ac92-e256297e0679/manager/0.log" Jun 13 05:48:46.585037 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:46.585011 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2fq6x_50adff34-e886-49c0-bb54-18e6b4a580bc/discovery/0.log" Jun 13 05:48:46.688188 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:46.688158 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-l55qg_29d8627a-90ab-4936-a4ed-6e67016c52de/kube-auth-proxy/0.log" Jun 13 05:48:47.135707 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:47.135675 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7wlv9_7f098c97-f5d1-46fe-9916-b81f1d804880/payload-processing/0.log" Jun 13 05:48:47.590764 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:47.590707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh_350b50a7-60b6-4a58-aeba-627a416531db/main/0.log" Jun 13 05:48:47.597838 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:47.597806 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lqsrh_350b50a7-60b6-4a58-aeba-627a416531db/storage-initializer/0.log" Jun 13 05:48:47.829436 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:47.829407 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h_f06720f6-6efa-4b04-bacc-adb75eeb5aa1/storage-initializer/0.log" Jun 13 05:48:47.835794 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:47.835776 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-qqx9h_f06720f6-6efa-4b04-bacc-adb75eeb5aa1/main/0.log" Jun 13 05:48:47.945497 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:47.945426 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvlsrp_c76ad089-7740-4c6b-b03e-15c45612441e/storage-initializer/0.log" Jun 13 05:48:48.065567 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:48.065541 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h_e0df05a2-9004-4fd9-bd9c-dd916e14f9b2/storage-initializer/0.log" Jun 13 05:48:48.072114 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:48.072092 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-kpx9h_e0df05a2-9004-4fd9-bd9c-dd916e14f9b2/main/0.log" Jun 13 05:48:54.946332 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:54.946300 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2bpsg_63212e1d-8ecf-438b-ba7c-00dd6809dec4/global-pull-secret-syncer/0.log" Jun 13 05:48:55.118618 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:55.118590 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxz5z_340a413f-7c23-4de1-9aaf-bf0efacbd63d/konnectivity-agent/0.log" Jun 13 05:48:55.136840 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:55.136816 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-198.ec2.internal_325dc2cb6d43f6fe0a18472a3561b341/haproxy/0.log" Jun 13 05:48:58.941101 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:48:58.941067 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-9wtmg_1febf861-eb79-4ea8-9432-94e5b237f890/sail-operator/0.log" Jun 13 05:49:00.333558 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:00.333525 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c9bxk_b98672c9-e912-49dc-b7a2-628150169218/manager/0.log" Jun 13 05:49:00.484770 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:00.484741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tsjzv_5a0cadc7-1398-4f5a-ac92-e256297e0679/manager/0.log" Jun 13 05:49:02.560089 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:02.560059 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-789cf76cbc-85dtt_834368de-0907-4b20-8bfe-06e90f033710/metrics-server/0.log" Jun 13 05:49:02.780809 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:02.780769 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcpq6_cb88a316-bf0f-48a9-95b8-de9140c6f414/node-exporter/0.log" Jun 13 05:49:02.813374 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:02.813277 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcpq6_cb88a316-bf0f-48a9-95b8-de9140c6f414/kube-rbac-proxy/0.log" Jun 13 05:49:02.837072 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:02.837042 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcpq6_cb88a316-bf0f-48a9-95b8-de9140c6f414/init-textfile/0.log" Jun 13 05:49:05.324123 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.324083 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr"] Jun 13 05:49:05.327807 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.327785 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.330227 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.330205 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lcd84\"/\"kube-root-ca.crt\"" Jun 13 05:49:05.330359 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.330290 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lcd84\"/\"default-dockercfg-446qj\"" Jun 13 05:49:05.331421 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.331302 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lcd84\"/\"openshift-service-ca.crt\"" Jun 13 05:49:05.337026 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.337003 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr"] Jun 13 05:49:05.375822 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.375787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-lib-modules\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.375989 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.375827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-podres\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.375989 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.375895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-proc\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.375989 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.375962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-sys\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.376103 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.375998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkgwt\" (UniqueName: \"kubernetes.io/projected/18a62007-a8e0-48bc-9c47-eda247a42ca5-kube-api-access-tkgwt\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476803 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-proc\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-sys\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgwt\" (UniqueName: \"kubernetes.io/projected/18a62007-a8e0-48bc-9c47-eda247a42ca5-kube-api-access-tkgwt\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-proc\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-sys\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-lib-modules\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.476986 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.476964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-podres\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.477197 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.477031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-lib-modules\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.477197 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.477060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18a62007-a8e0-48bc-9c47-eda247a42ca5-podres\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.484943 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.484921 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkgwt\" (UniqueName: \"kubernetes.io/projected/18a62007-a8e0-48bc-9c47-eda247a42ca5-kube-api-access-tkgwt\") pod \"perf-node-gather-daemonset-62ndr\" (UID: \"18a62007-a8e0-48bc-9c47-eda247a42ca5\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.638997 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.638907 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:05.773788 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:05.773759 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr"] Jun 13 05:49:05.775614 ip-10-0-130-198 kubenswrapper[2566]: W0613 05:49:05.775584 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18a62007_a8e0_48bc_9c47_eda247a42ca5.slice/crio-ad63395336dcc99fc8468cf95508e30ce96e3e0b75b90c262ff82cf6590dc6ba WatchSource:0}: Error finding container ad63395336dcc99fc8468cf95508e30ce96e3e0b75b90c262ff82cf6590dc6ba: Status 404 returned error can't find the container with id ad63395336dcc99fc8468cf95508e30ce96e3e0b75b90c262ff82cf6590dc6ba Jun 13 05:49:06.441639 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:06.441598 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" event={"ID":"18a62007-a8e0-48bc-9c47-eda247a42ca5","Type":"ContainerStarted","Data":"a770e972b217e963e13029b0664568609a5f99faff3690e89562a1f269724e8c"} Jun 13 05:49:06.442063 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:06.441682 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" event={"ID":"18a62007-a8e0-48bc-9c47-eda247a42ca5","Type":"ContainerStarted","Data":"ad63395336dcc99fc8468cf95508e30ce96e3e0b75b90c262ff82cf6590dc6ba"} Jun 13 05:49:06.442063 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:06.441728 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:06.458588 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:06.458533 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" podStartSLOduration=1.458515936 podStartE2EDuration="1.458515936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:49:06.456013252 +0000 UTC m=+1472.265985920" watchObservedRunningTime="2026-06-13 05:49:06.458515936 +0000 UTC m=+1472.268488606" Jun 13 05:49:07.799378 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:07.799307 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt2dt_456a212c-6a21-4304-ae5a-9343986e6cd8/dns/0.log" Jun 13 05:49:07.821861 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:07.821828 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt2dt_456a212c-6a21-4304-ae5a-9343986e6cd8/kube-rbac-proxy/0.log" Jun 13 05:49:07.888625 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:07.888597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7lgq_6ddddc73-e38f-48b8-ac72-ece19246ba96/dns-node-resolver/0.log" Jun 13 05:49:08.447562 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:08.447528 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-857b8d564b-zfgfh_f2ea84a0-53ef-460c-bca4-31aa27cf0d4f/registry/0.log" Jun 13 05:49:08.453004 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:08.452973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-857b8d564b-zfgfh_f2ea84a0-53ef-460c-bca4-31aa27cf0d4f/registry/1.log" Jun 13 05:49:08.496328 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:08.496302 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m982k_f7207946-297b-4717-9bc1-f8881a1fe3de/node-ca/0.log" Jun 13 05:49:09.471995 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:09.471959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2fq6x_50adff34-e886-49c0-bb54-18e6b4a580bc/discovery/0.log" Jun 13 05:49:09.495799 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:09.495770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-l55qg_29d8627a-90ab-4936-a4ed-6e67016c52de/kube-auth-proxy/0.log" Jun 13 05:49:09.599532 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:09.599501 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7wlv9_7f098c97-f5d1-46fe-9916-b81f1d804880/payload-processing/0.log" Jun 13 05:49:10.286679 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:10.286630 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nx8cq_46b4b7f8-1c30-4340-a45d-35d98cbd576a/serve-healthcheck-canary/0.log" Jun 13 05:49:11.063665 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:11.063635 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbmw9_743aba5e-b336-4c13-aef1-13ecd9aeaecf/kube-rbac-proxy/0.log" Jun 13 05:49:11.097454 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:11.097430 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbmw9_743aba5e-b336-4c13-aef1-13ecd9aeaecf/exporter/0.log" Jun 13 05:49:11.128738 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:11.128711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbmw9_743aba5e-b336-4c13-aef1-13ecd9aeaecf/extractor/0.log" Jun 13 05:49:12.457339 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:12.457307 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-62ndr" Jun 13 05:49:13.342148 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.342097 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d74f576d6-w94nn_888e3659-aa0f-448f-a4be-29db18a91bed/nginx/0.log" Jun 13 05:49:13.367931 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.367901 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-rx7rf_9b371441-df5e-42a4-a5aa-3ce5c550e844/manager/0.log" Jun 13 05:49:13.404120 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.404085 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-tnv92_e856bd84-850b-4211-a160-977dc3bd8724/manager/0.log" Jun 13 05:49:13.426691 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.426666 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64b976948f-9ggjc_85d7e937-dfd6-4a5f-a9fb-118715daf7fa/maas-api/0.log" Jun 13 05:49:13.497729 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.497702 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-82hqq_13e65c22-e030-45af-833e-95e84125fdfd/server/0.log" Jun 13 05:49:13.543837 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.543794 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-f49sv_3cee15ff-2051-4e26-85a9-11440e2d575d/manager/0.log" Jun 13 05:49:13.568922 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.568893 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-7g55f_f32f0884-10b0-42cf-a195-b13e74eab96b/manager/0.log" Jun 13 05:49:13.588568 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.588536 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-7g55f_f32f0884-10b0-42cf-a195-b13e74eab96b/copy-manifests/0.log" Jun 13 05:49:13.734364 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:13.734277 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7ddgg_c89aace8-9b5a-4fd4-87a8-056e0e0e7c72/postgres/0.log" Jun 13 05:49:19.606209 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:19.606160 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2fq6x_50adff34-e886-49c0-bb54-18e6b4a580bc/discovery/0.log" Jun 13 05:49:19.615127 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:19.615107 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-l55qg_29d8627a-90ab-4936-a4ed-6e67016c52de/kube-auth-proxy/0.log" Jun 13 05:49:19.674622 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:19.674585 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7wlv9_7f098c97-f5d1-46fe-9916-b81f1d804880/payload-processing/0.log" Jun 13 05:49:20.740303 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:20.740267 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2fq6x_50adff34-e886-49c0-bb54-18e6b4a580bc/discovery/0.log" Jun 13 05:49:20.750367 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:20.750340 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-l55qg_29d8627a-90ab-4936-a4ed-6e67016c52de/kube-auth-proxy/0.log" Jun 13 05:49:20.809020 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:20.808992 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7wlv9_7f098c97-f5d1-46fe-9916-b81f1d804880/payload-processing/0.log" Jun 13 05:49:22.352317 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.352268 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8j6jw_7e0ffef5-efc3-4f9b-9d71-629b0395a53b/kube-multus/0.log" Jun 13 05:49:22.376841 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.376807 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/kube-multus-additional-cni-plugins/0.log" Jun 13 05:49:22.397301 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.397271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/egress-router-binary-copy/0.log" Jun 13 05:49:22.417765 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.417731 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/cni-plugins/0.log" Jun 13 05:49:22.438131 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.438101 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/bond-cni-plugin/0.log" Jun 13 05:49:22.458142 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.458120 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/routeoverride-cni/0.log" Jun 13 05:49:22.478310 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.478285 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/whereabouts-cni-bincopy/0.log" Jun 13 05:49:22.498900 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.498874 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcrjt_806644ce-16a7-4599-be11-4bf2634a2bd5/whereabouts-cni/0.log" Jun 13 05:49:22.499733 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.499715 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2fq6x_50adff34-e886-49c0-bb54-18e6b4a580bc/discovery/0.log" Jun 13 05:49:22.508081 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.508064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-l55qg_29d8627a-90ab-4936-a4ed-6e67016c52de/kube-auth-proxy/0.log" Jun 13 05:49:22.569254 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.569223 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7wlv9_7f098c97-f5d1-46fe-9916-b81f1d804880/payload-processing/0.log" Jun 13 05:49:22.914936 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.914903 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lvpgj_93bc553b-de82-4307-93d9-b909bcbe2069/network-metrics-daemon/0.log" Jun 13 05:49:22.934798 ip-10-0-130-198 kubenswrapper[2566]: I0613 05:49:22.934769 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lvpgj_93bc553b-de82-4307-93d9-b909bcbe2069/kube-rbac-proxy/0.log"