Jun 03 19:20:50.130373 ip-10-0-129-220 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:20:50.571150 ip-10-0-129-220 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:50.571150 ip-10-0-129-220 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:20:50.571150 ip-10-0-129-220 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:50.571150 ip-10-0-129-220 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:20:50.571150 ip-10-0-129-220 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:50.572174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.572088 2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:20:50.576573 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576555 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:50.576573 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576573 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576578 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576582 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576585 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576588 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576590 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576594 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576597 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576601 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576604 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576607 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576610 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576613 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576615 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576618 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576621 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576623 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576626 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576629 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576631 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:50.576641 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576634 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576637 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576640 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576643 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576646 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576649 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576652 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576655 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576658 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576660 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576663 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576665 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576668 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576671 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576674 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576676 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576680 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576682 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576685 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576688 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:50.577154 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576690 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576694 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576698 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576702 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576705 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576708 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576711 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576715 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576719 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576722 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576724 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576727 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576729 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576733 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576736 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576738 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576741 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576745 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576748 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:50.577645 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576751 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576754 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576756 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576759 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576761 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576763 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576766 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576769 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576772 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576774 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576777 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576780 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576782 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576785 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576787 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576790 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576792 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576795 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576797 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576800 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:50.578135 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576802 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576805 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576808 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576810 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576813 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576815 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576819 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576823 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576826 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576829 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576832 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576834 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576837 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576840 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576842 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576845 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576847 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.576850 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577601 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:50.578619 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577608 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577611 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577613 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577617 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577619 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577623 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577627 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577630 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577632 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577635 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577638 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577641 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577643 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577646 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577649 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577651 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577655 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577658 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577660 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577664 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:50.579100 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577667 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577670 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577672 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577675 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577677 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577680 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577683 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577685 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577688 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577693 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577697 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577700 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577703 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577706 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577708 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577711 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577714 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577716 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577719 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577721 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:50.579609 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577724 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577727 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577730 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577732 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577736 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577739 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577742 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577744 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577747 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577752 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577755 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577758 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577761 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577763 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577766 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577768 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577771 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577773 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577776 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577779 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:50.580118 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577782 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577785 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577787 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577790 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577792 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577795 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577799 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577802 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577804 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577807 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577809 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577812 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577815 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577818 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577821 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577823 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577826 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577828 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577832 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:50.580606 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577836 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577840 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577843 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577846 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577849 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577852 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577855 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577858 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577860 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577863 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577866 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577868 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577871 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577873 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577876 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577878 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577881 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.577883 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578294 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578299 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:50.581109 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578302 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578305 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578307 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578310 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578312 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578315 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578318 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578321 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578325 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578328 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578331 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578334 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578337 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578340 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578343 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578346 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578349 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578352 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578355 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:50.581596 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578359 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578363 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578366 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578369 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578372 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578375 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578377 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578380 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578382 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578385 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578387 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578389 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578392 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578395 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578397 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578400 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578402 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578404 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578407 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578410 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:50.582088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578412 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578415 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578417 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578419 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578422 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578425 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578427 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578430 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578432 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578435 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578438 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578440 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578443 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578445 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578448 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578450 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578453 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578455 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578457 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578460 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:50.582642 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578462 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578465 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578467 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578470 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578472 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578475 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578477 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578480 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578482 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578485 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578488 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578490 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578493 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578496 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578498 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578501 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578508 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578511 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578514 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578516 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:50.583172 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578520 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578523 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578526 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578528 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578531 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578533 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578536 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578538 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578543 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578546 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578549 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578551 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578555 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578557 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578560 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578563 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.578565 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578643 2550 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578651 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578657 2550 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578662 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:20:50.583667 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578666 2550 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578670 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578674 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578678 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578681 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578684 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578688 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578693 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578696 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578699 2550 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578702 2550 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578709 2550 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578712 2550 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578715 2550 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578720 2550 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578724 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578727 2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578730 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578734 2550 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578738 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578741 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578744 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578747 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578751 2550 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:20:50.584196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578754 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578757 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578760 2550 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578763 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578766 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578769 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578772 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578775 2550 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578778 2550 flags.go:64] FLAG: --enable-server="true" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578781 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578786 2550 flags.go:64] FLAG: --event-burst="100" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578789 2550 flags.go:64] FLAG: --event-qps="50" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578792 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578795 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578798 2550 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578803 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578806 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578809 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578812 2550 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578816 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578819 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578822 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578825 2550 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578829 2550 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578832 2550 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:20:50.584817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578835 2550 flags.go:64] FLAG: --feature-gates="" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578838 2550 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578841 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578844 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578848 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578850 2550 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578854 2550 flags.go:64] FLAG: --help="false" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578856 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578859 2550 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578862 2550 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578865 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578868 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578872 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578874 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578877 2550 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578880 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578883 2550 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578886 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578889 2550 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578892 2550 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578895 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578898 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578902 2550 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578904 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:20:50.585611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578907 2550 flags.go:64] FLAG: --lock-file="" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578910 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578914 2550 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578917 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578922 2550 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578925 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578928 2550 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578931 2550 flags.go:64] FLAG: --logging-format="text" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578934 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578938 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578940 2550 flags.go:64] FLAG: --manifest-url="" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578943 2550 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578947 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578950 2550 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578954 2550 flags.go:64] FLAG: --max-pods="110" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578957 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578960 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578963 2550 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578966 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578969 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578972 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578975 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578981 2550 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578984 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578987 2550 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:20:50.586323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578990 2550 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578993 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.578998 2550 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579001 2550 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579004 2550 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579007 2550 flags.go:64] FLAG: --port="10250" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579012 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579015 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccb2a6d5dec8f5bf" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579018 2550 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579023 2550 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579026 2550 flags.go:64] FLAG: --register-node="true" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579042 2550 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579046 2550 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579049 2550 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579052 2550 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579055 2550 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579059 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579062 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579065 2550 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579068 2550 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579071 2550 flags.go:64] FLAG: --runonce="false" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579074 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579076 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579079 2550 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579082 2550 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:20:50.587270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579085 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579088 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579091 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579094 2550 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579097 2550 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579099 2550 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579102 2550 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579105 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579109 2550 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579112 2550 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579115 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579120 2550 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579123 2550 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579127 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579131 2550 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579134 2550 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579139 2550 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579142 2550 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579145 2550 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579148 2550 flags.go:64] FLAG: --v="2" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579152 2550 flags.go:64] FLAG: --version="false" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579156 2550 flags.go:64] FLAG: --vmodule="" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579159 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.579163 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579280 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:50.587897 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579283 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579286 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579289 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579292 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579295 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579298 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579301 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579303 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579305 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579308 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579311 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579313 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579316 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579318 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579321 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579324 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579327 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579330 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579334 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579337 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:50.588561 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579342 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579345 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579347 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579352 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579354 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579357 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579360 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579362 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579365 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579368 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579370 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579374 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579376 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579379 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579382 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579384 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579387 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579389 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579392 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579394 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:50.589075 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579397 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579399 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579402 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579405 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579407 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579410 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579413 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579418 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579421 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579424 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579427 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579430 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579434 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579437 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579440 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579443 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579446 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579449 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579452 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:50.589574 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579454 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579457 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579460 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579462 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579465 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579468 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579471 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579474 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579477 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579479 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579482 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579484 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579487 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579489 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579492 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579495 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579497 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579500 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579502 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:50.590106 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579505 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579508 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579510 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579513 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579515 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579517 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579521 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579524 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579526 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579530 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579532 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579535 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579537 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579540 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579542 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579545 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579548 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579550 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:50.590583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.579553 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.580073 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.587955 2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.588088 2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.589177 2550 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.589184 2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589243 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589248 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589252 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589255 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589258 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589262 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589265 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589268 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:50.591022 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589270 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589273 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589276 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589279 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589281 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589284 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589287 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589289 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589292 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589295 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589298 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589300 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589303 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589307 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589309 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589312 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589316 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589320 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589323 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:50.591405 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589325 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589329 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589334 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589337 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589340 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589343 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589346 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589349 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589352 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589355 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589357 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589360 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589363 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589366 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589368 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589371 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589374 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589376 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589379 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:50.591867 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589382 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589386 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589389 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589392 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589395 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589398 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589401 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589404 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589407 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589409 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589412 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589414 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589417 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589420 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589423 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589426 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589428 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589431 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589434 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589436 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:50.592483 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589439 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589441 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589444 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589446 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589449 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589452 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589454 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589457 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589460 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589462 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589465 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589467 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589470 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589473 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589476 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589478 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589481 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589483 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589486 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589489 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:50.592966 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589491 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589494 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589496 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589499 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589501 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589505 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589507 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589510 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589513 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589516 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589519 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589521 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.589526 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589655 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589659 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:50.593472 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589663 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589665 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589668 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589671 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589674 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589676 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589679 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589682 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589684 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589687 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589689 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589692 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589695 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589699 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589703 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589706 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589709 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589711 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589714 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589716 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:50.593842 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589719 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589722 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589724 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589727 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589729 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589732 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589735 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589737 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589740 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589742 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589745 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589747 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589750 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589752 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589755 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589758 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589760 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589763 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589765 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589768 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:50.594365 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589771 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589773 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589775 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589778 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589781 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589784 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589788 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589791 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589794 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589797 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589800 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589803 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589806 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589809 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589812 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589815 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589818 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589820 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589823 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:50.594868 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589826 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589828 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589832 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589835 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589837 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589840 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589843 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589846 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589848 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589850 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589853 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589855 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589859 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589861 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589864 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589866 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589869 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589871 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589875 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589878 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:50.595340 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589880 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589883 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589885 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589888 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589891 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589893 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589896 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589898 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589902 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589905 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589908 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589910 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589913 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589916 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589918 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589921 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:50.595845 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:50.589923 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:50.596361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.589928 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:50.596361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.590057 2550 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:20:50.596361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.594073 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:20:50.596361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.595421 2550 server.go:1019] "Starting client certificate rotation" Jun 03 19:20:50.596361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.595516 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:20:50.596361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.595556 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:20:50.598442 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.598429 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:20:50.601664 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.601646 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:20:50.613595 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.613576 2550 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:20:50.616815 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.616798 2550 log.go:25] "Validated CRI v1 image API" Jun 03 19:20:50.617552 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.617540 2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:20:50.621183 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.621159 2550 fs.go:135] Filesystem UUIDs: map[5abaf8ad-a94b-4d0b-8b36-2c65f1b5efef:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de23800f-37f2-4493-bfbb-28add593787c:/dev/nvme0n1p3] Jun 03 19:20:50.621255 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.621181 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:20:50.627277 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.627251 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:20:50.628467 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.628089 2550 manager.go:216] Machine: {Timestamp:2026-06-03 19:20:50.626230568 +0000 UTC m=+0.366142643 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093921 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21ff5ab156a70423d7b4f02d6c46e2 SystemUUID:ec21ff5a-b156-a704-23d7-b4f02d6c46e2 BootID:e70afdec-42e7-428e-a9bf-16bb2a33364d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:cb:d9:58:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:cb:d9:58:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:94:9b:6d:22:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:20:50.628467 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.628461 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:20:50.628651 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.628635 2550 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:20:50.631700 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.631667 2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:20:50.631836 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.631703 2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:20:50.632756 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.632745 2550 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:20:50.632788 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.632759 2550 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:20:50.632788 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.632766 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:20:50.632788 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.632781 2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:20:50.633565 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.633555 2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:20:50.636579 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636567 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:20:50.636695 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636686 2550 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:20:50.636728 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636717 2550 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:20:50.636759 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636732 2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:20:50.636759 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636750 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:20:50.636817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636764 2550 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:20:50.636817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.636776 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:20:50.637557 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.637542 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:20:50.637608 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.637571 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:20:50.640174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.640160 2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:20:50.641481 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.641468 2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:20:50.641532 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.641498 2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:20:50.642262 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642250 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642268 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642276 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642282 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642290 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642295 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642303 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:20:50.642304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642308 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:20:50.642601 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642314 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:20:50.642601 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642319 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:20:50.642601 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642331 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:20:50.642601 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.642338 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:20:50.643169 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.643159 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:20:50.643169 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.643170 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:20:50.646168 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.646155 2550 server.go:1268] "Started kubelet" Jun 03 19:20:50.646323 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.646227 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:20:50.647166 ip-10-0-129-220 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:20:50.647841 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.647215 2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:20:50.647841 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.647368 2550 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:20:50.648326 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.648222 2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:20:50.648326 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.648293 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:20:50.648444 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.648388 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:20:50.648489 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.648480 2550 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:20:50.650295 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.650270 2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:20:50.654917 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.654897 2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:20:50.655492 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.655477 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:20:50.655566 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.655507 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:20:50.655905 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.655879 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:50.656332 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656312 2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:20:50.656407 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656368 2550 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:20:50.656407 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656382 2550 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:20:50.656500 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656466 2550 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:20:50.656500 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656476 2550 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:20:50.656595 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656550 2550 factory.go:55] Registering systemd factory Jun 03 19:20:50.656595 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656565 2550 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:20:50.656783 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656765 2550 factory.go:153] Registering CRI-O factory Jun 03 19:20:50.656783 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656785 2550 factory.go:223] Registration of the crio container factory successfully Jun 03 19:20:50.656939 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656834 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:20:50.656939 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656857 2550 factory.go:103] Registering Raw factory Jun 03 19:20:50.656939 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.656875 2550 manager.go:1196] Started watching for new ooms in manager Jun 03 19:20:50.657422 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.657405 2550 manager.go:349] Starting recovery of all containers Jun 03 19:20:50.657514 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.656274 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-220.ec2.internal.18b5a87594365939 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-220.ec2.internal,UID:ip-10-0-129-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-220.ec2.internal,},FirstTimestamp:2026-06-03 19:20:50.646128953 +0000 UTC m=+0.386041025,LastTimestamp:2026-06-03 19:20:50.646128953 +0000 UTC m=+0.386041025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-220.ec2.internal,}" Jun 03 19:20:50.664724 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.664691 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:20:50.666284 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.666255 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:20:50.666391 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.666336 2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:20:50.670010 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.669945 2550 manager.go:354] Recovery completed Jun 03 19:20:50.673946 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.673931 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.675703 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.675686 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.675773 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.675720 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.675773 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.675734 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.676263 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676248 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:20:50.676263 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676260 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:20:50.676393 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676251 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.676393 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676275 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:20:50.676966 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676948 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.677056 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676974 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.677056 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676979 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sh752" Jun 03 19:20:50.677056 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.676984 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.677464 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.677451 2550 policy_none.go:49] "None policy: Start" Jun 03 19:20:50.677503 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.677467 2550 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:20:50.677503 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.677477 2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:20:50.677938 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.677869 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-220.ec2.internal.18b5a87595f99ebe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-220.ec2.internal,UID:ip-10-0-129-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-220.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-220.ec2.internal,},FirstTimestamp:2026-06-03 19:20:50.675703486 +0000 UTC m=+0.415615565,LastTimestamp:2026-06-03 19:20:50.675703486 +0000 UTC m=+0.415615565,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-220.ec2.internal,}" Jun 03 19:20:50.678375 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.678364 2550 policy_none.go:47] "Start" Jun 03 19:20:50.685621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.685604 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sh752" Jun 03 19:20:50.687275 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.687208 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-220.ec2.internal.18b5a87595f9fcac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-220.ec2.internal,UID:ip-10-0-129-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-220.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-220.ec2.internal,},FirstTimestamp:2026-06-03 19:20:50.675727532 +0000 UTC m=+0.415639605,LastTimestamp:2026-06-03 19:20:50.675727532 +0000 UTC m=+0.415639605,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-220.ec2.internal,}" Jun 03 19:20:50.713714 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.713695 2550 manager.go:337] "Starting Device Plugin manager" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.713735 2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.713751 2550 server.go:87] "Starting device plugin registration server" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.713989 2550 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.714001 2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.714098 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.714182 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.714189 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.715011 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.715070 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.723157 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.723194 2550 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.723214 2550 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.723243 2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:20:50.726452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.725454 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:50.814542 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.814514 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.815517 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.815498 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.815621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.815535 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.815621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.815549 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.815621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.815578 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.824266 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.824199 2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal"] Jun 03 19:20:50.824342 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.824279 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.825627 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.825611 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.825718 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.825643 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.825718 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.825700 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.826679 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.826663 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.826745 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.826685 2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-220.ec2.internal\": node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:50.826880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.826867 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.826987 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.826972 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.827055 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827002 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.827637 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827619 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.827715 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827651 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.827715 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827667 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.827715 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827666 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.827715 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827699 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.827715 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.827713 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.828755 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.828741 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.828812 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.828764 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:50.829465 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.829452 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:50.829541 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.829478 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:50.829541 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.829492 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:50.852722 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.852698 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-220.ec2.internal\" not found" node="ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.856998 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.856983 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-220.ec2.internal\" not found" node="ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.858059 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.858024 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/172208cb942795fc0463350e6867edd8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-220.ec2.internal\" (UID: \"172208cb942795fc0463350e6867edd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.858146 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.858068 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/083a0ab327601c93fa7b5b44b24c43e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal\" (UID: \"083a0ab327601c93fa7b5b44b24c43e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.858146 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.858116 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/083a0ab327601c93fa7b5b44b24c43e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal\" (UID: \"083a0ab327601c93fa7b5b44b24c43e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.863868 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.863854 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:50.958825 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.958798 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/083a0ab327601c93fa7b5b44b24c43e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal\" (UID: \"083a0ab327601c93fa7b5b44b24c43e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.958825 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.958827 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/172208cb942795fc0463350e6867edd8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-220.ec2.internal\" (UID: \"172208cb942795fc0463350e6867edd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.959071 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.958846 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/083a0ab327601c93fa7b5b44b24c43e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal\" (UID: \"083a0ab327601c93fa7b5b44b24c43e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.959071 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.958892 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/083a0ab327601c93fa7b5b44b24c43e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal\" (UID: \"083a0ab327601c93fa7b5b44b24c43e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.959071 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.958901 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/083a0ab327601c93fa7b5b44b24c43e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal\" (UID: \"083a0ab327601c93fa7b5b44b24c43e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.959071 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:50.958908 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/172208cb942795fc0463350e6867edd8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-220.ec2.internal\" (UID: \"172208cb942795fc0463350e6867edd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" Jun 03 19:20:50.964906 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:50.964888 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:51.065627 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.065598 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:51.156150 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.156083 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:51.162152 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.162101 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" Jun 03 19:20:51.165709 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.165688 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:51.266334 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.266293 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:51.366805 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.366772 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:51.467397 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.467314 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-220.ec2.internal\" not found" Jun 03 19:20:51.555089 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.555063 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:51.556014 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.555998 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" Jun 03 19:20:51.569818 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.569793 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:20:51.571632 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.571616 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" Jun 03 19:20:51.577174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.577154 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:51.580286 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.580269 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:20:51.595490 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.595465 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:20:51.595621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.595604 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:20:51.595666 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.595641 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:20:51.595666 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.595644 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:20:51.637797 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.637768 2550 apiserver.go:52] "Watching apiserver" Jun 03 19:20:51.655882 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.655856 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:20:51.658742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.658716 2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:20:51.660146 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.660124 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hs9n8","openshift-multus/multus-additional-cni-plugins-fknl2","openshift-multus/multus-ks8kd","openshift-multus/network-metrics-daemon-25zwz","openshift-ovn-kubernetes/ovnkube-node-ztks7","kube-system/konnectivity-agent-st6xc","kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal","openshift-network-diagnostics/network-check-target-rvs9p","openshift-network-operator/iptables-alerter-h2vj9","kube-system/global-pull-secret-syncer-9mnv9","openshift-cluster-node-tuning-operator/tuned-ggmkj","openshift-dns/node-resolver-57vsp"] Jun 03 19:20:51.661441 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.661425 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.662466 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.662443 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.663766 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.663750 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.664556 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.664528 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:20:51.664648 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.664555 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.664847 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.664835 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:51.664914 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.664897 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:20:51.665341 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.665320 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.665444 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.665350 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8jrb2\"" Jun 03 19:20:51.665789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.665771 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.666018 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.665997 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.666137 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.666020 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:20:51.667155 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667117 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4bzd2\"" Jun 03 19:20:51.667244 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667168 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:20:51.667244 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667174 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.667244 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667208 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.667244 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667210 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:20:51.667432 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667274 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-425bm\"" Jun 03 19:20:51.667651 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667632 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.667755 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.667633 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.668553 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.668534 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:20:51.668655 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.668636 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.668756 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.668661 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mgswd\"" Jun 03 19:20:51.668871 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.668856 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.669135 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.669119 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.671157 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.670703 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bqjp\"" Jun 03 19:20:51.671157 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.670721 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:20:51.671157 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.670708 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:20:51.671157 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.670826 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:20:51.672221 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.672197 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xqt6d\"" Jun 03 19:20:51.672763 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.672745 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:51.672856 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.672811 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:20:51.673915 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.673895 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:20:51.674176 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.673905 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:20:51.674277 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.673987 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:20:51.674277 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.674066 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.674387 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.674061 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:20:51.674387 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.674084 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.674387 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.674231 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.675468 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.675449 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.675585 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.675545 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:20:51.676649 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.676629 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.677078 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.677059 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-77cdc\"" Jun 03 19:20:51.677179 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.677116 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.677242 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.677184 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.677623 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.677604 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:20:51.677830 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.677811 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.679452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.679435 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:20:51.679543 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.679450 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nb6jm\"" Jun 03 19:20:51.680515 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.680495 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:20:51.680642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.680613 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wbtv\"" Jun 03 19:20:51.680946 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.680933 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:20:51.687827 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.687786 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:15:50 +0000 UTC" deadline="2028-03-12 03:06:39.51958251 +0000 UTC" Jun 03 19:20:51.687827 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.687825 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15535h45m47.831760937s" Jun 03 19:20:51.693961 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.693939 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-44qdc" Jun 03 19:20:51.700495 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.700471 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-44qdc" Jun 03 19:20:51.753893 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:51.753861 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172208cb942795fc0463350e6867edd8.slice/crio-7be16c19b13bb06826bb814569bcb95690ce0a2c9047cb523e9c26df4a62be30 WatchSource:0}: Error finding container 7be16c19b13bb06826bb814569bcb95690ce0a2c9047cb523e9c26df4a62be30: Status 404 returned error can't find the container with id 7be16c19b13bb06826bb814569bcb95690ce0a2c9047cb523e9c26df4a62be30 Jun 03 19:20:51.754662 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:51.754637 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a0ab327601c93fa7b5b44b24c43e8.slice/crio-c62827b325b12e0b2d4d3e610a2ac8fdce8ab68b3122ac6cbde958a0fb060ba1 WatchSource:0}: Error finding container c62827b325b12e0b2d4d3e610a2ac8fdce8ab68b3122ac6cbde958a0fb060ba1: Status 404 returned error can't find the container with id c62827b325b12e0b2d4d3e610a2ac8fdce8ab68b3122ac6cbde958a0fb060ba1 Jun 03 19:20:51.758345 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.758327 2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:20:51.759749 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.759733 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:20:51.762443 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762411 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1185c226-3dc7-4eab-a916-edd22a0a9638-iptables-alerter-script\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.762548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762446 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-k8s-cni-cncf-io\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.762548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762472 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-hostroot\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.762548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762496 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6pn\" (UniqueName: \"kubernetes.io/projected/6ff193ad-01c5-4644-990a-635a05c8984b-kube-api-access-bf6pn\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.762548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762520 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.762548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762544 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqndh\" (UniqueName: \"kubernetes.io/projected/c441402a-6cc1-4eeb-99b4-7191366c54ea-kube-api-access-dqndh\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762568 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-run-netns\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762590 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-node-log\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762616 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762640 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-cni-multus\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762663 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drtxq\" (UniqueName: \"kubernetes.io/projected/bd4f8689-587c-4232-b088-0d9a751ebc18-kube-api-access-drtxq\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762690 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-system-cni-dir\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762712 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:51.762789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762756 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f40e3138-3c73-4607-881b-997cd7c41761-etc-tuned\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762801 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-device-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762826 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f89672f0-b4e2-4b38-a251-0a6f0aae67bc-konnectivity-ca\") pod \"konnectivity-agent-st6xc\" (UID: \"f89672f0-b4e2-4b38-a251-0a6f0aae67bc\") " pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762844 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wclwr\" (UniqueName: \"kubernetes.io/projected/ca503c44-374a-4d1d-815e-a257a50b5684-kube-api-access-wclwr\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762861 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822c5330-5f6b-4384-9675-d7f1dd971a11-host\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762883 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-os-release\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762914 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-systemd\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762937 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762963 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-ovnkube-script-lib\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.762982 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/822c5330-5f6b-4384-9675-d7f1dd971a11-serviceca\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763048 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cni-binary-copy\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763079 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp92k\" (UniqueName: \"kubernetes.io/projected/1185c226-3dc7-4eab-a916-edd22a0a9638-kube-api-access-mp92k\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763122 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-multus-certs\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763161 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-netns\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763185 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysctl-conf\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763210 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f89672f0-b4e2-4b38-a251-0a6f0aae67bc-agent-certs\") pod \"konnectivity-agent-st6xc\" (UID: \"f89672f0-b4e2-4b38-a251-0a6f0aae67bc\") " pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763232 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-conf-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763263 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4f8689-587c-4232-b088-0d9a751ebc18-tmp-dir\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763280 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysconfig\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763294 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-sys\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763328 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763348 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763365 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-cnibin\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763394 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ff193ad-01c5-4644-990a-635a05c8984b-multus-daemon-config\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763423 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-etc-kubernetes\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763439 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzvh\" (UniqueName: \"kubernetes.io/projected/f40e3138-3c73-4607-881b-997cd7c41761-kube-api-access-9kzvh\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763462 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763483 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-env-overrides\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763513 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a28252b2-300b-4164-8967-7a686cce1551-kubelet-config\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763540 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd4f8689-587c-4232-b088-0d9a751ebc18-hosts-file\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763554 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-cni-bin\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.763866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763587 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-cni-netd\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763629 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca503c44-374a-4d1d-815e-a257a50b5684-ovn-node-metrics-cert\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763652 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-cni-bin\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763686 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40e3138-3c73-4607-881b-997cd7c41761-tmp\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763731 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-sys-fs\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763768 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-ovn\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763821 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a28252b2-300b-4164-8967-7a686cce1551-dbus\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763842 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763858 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-kubelet\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763906 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-var-lib-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763923 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763941 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-system-cni-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763957 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ff193ad-01c5-4644-990a-635a05c8984b-cni-binary-copy\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763971 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-run\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.763988 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-systemd-units\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764002 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-log-socket\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.764659 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764019 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764051 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-cni-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764116 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-kubelet\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764135 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-modprobe-d\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764150 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-kubernetes\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764166 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysctl-d\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764180 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-systemd\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764193 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-slash\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764210 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-ovnkube-config\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6bkz\" (UniqueName: \"kubernetes.io/projected/822c5330-5f6b-4384-9675-d7f1dd971a11-kube-api-access-v6bkz\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764240 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cnibin\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764254 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-host\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764271 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-registration-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764286 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-etc-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764309 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764330 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-os-release\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.765159 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764371 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltgs\" (UniqueName: \"kubernetes.io/projected/528914bf-a508-44f0-8c49-ae2bb5dbbd90-kube-api-access-5ltgs\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.765751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764413 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1185c226-3dc7-4eab-a916-edd22a0a9638-host-slash\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.765751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764451 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-socket-dir-parent\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.765751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764476 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-lib-modules\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764498 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-var-lib-kubelet\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.765751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764521 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j92pd\" (UniqueName: \"kubernetes.io/projected/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-kube-api-access-j92pd\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:51.765751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.764544 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-socket-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.865122 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865083 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-node-log\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.865122 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865120 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865137 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-cni-multus\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865152 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drtxq\" (UniqueName: \"kubernetes.io/projected/bd4f8689-587c-4232-b088-0d9a751ebc18-kube-api-access-drtxq\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865170 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-system-cni-dir\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865185 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865200 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f40e3138-3c73-4607-881b-997cd7c41761-etc-tuned\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865224 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-device-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865223 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-cni-multus\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865198 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-node-log\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865247 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f89672f0-b4e2-4b38-a251-0a6f0aae67bc-konnectivity-ca\") pod \"konnectivity-agent-st6xc\" (UID: \"f89672f0-b4e2-4b38-a251-0a6f0aae67bc\") " pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865271 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wclwr\" (UniqueName: \"kubernetes.io/projected/ca503c44-374a-4d1d-815e-a257a50b5684-kube-api-access-wclwr\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865280 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-system-cni-dir\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865290 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-device-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865294 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822c5330-5f6b-4384-9675-d7f1dd971a11-host\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865320 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-os-release\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865343 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-systemd\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.865373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865364 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865387 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-ovnkube-script-lib\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865410 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/822c5330-5f6b-4384-9675-d7f1dd971a11-serviceca\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865435 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cni-binary-copy\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865460 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp92k\" (UniqueName: \"kubernetes.io/projected/1185c226-3dc7-4eab-a916-edd22a0a9638-kube-api-access-mp92k\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865461 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-systemd\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865486 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-multus-certs\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865513 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-netns\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865519 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822c5330-5f6b-4384-9675-d7f1dd971a11-host\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865536 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysctl-conf\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865559 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f89672f0-b4e2-4b38-a251-0a6f0aae67bc-agent-certs\") pod \"konnectivity-agent-st6xc\" (UID: \"f89672f0-b4e2-4b38-a251-0a6f0aae67bc\") " pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865585 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-conf-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865589 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-os-release\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865609 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4f8689-587c-4232-b088-0d9a751ebc18-tmp-dir\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865600 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865679 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865717 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysconfig\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865758 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-sys\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.866170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865785 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865818 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865845 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-cnibin\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865870 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ff193ad-01c5-4644-990a-635a05c8984b-multus-daemon-config\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865878 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f89672f0-b4e2-4b38-a251-0a6f0aae67bc-konnectivity-ca\") pod \"konnectivity-agent-st6xc\" (UID: \"f89672f0-b4e2-4b38-a251-0a6f0aae67bc\") " pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865894 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-etc-kubernetes\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865921 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzvh\" (UniqueName: \"kubernetes.io/projected/f40e3138-3c73-4607-881b-997cd7c41761-kube-api-access-9kzvh\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865944 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865959 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865974 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-ovnkube-script-lib\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865979 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-env-overrides\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.865999 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-cnibin\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866022 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/822c5330-5f6b-4384-9675-d7f1dd971a11-serviceca\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866061 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-netns\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866066 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-etc-kubernetes\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866106 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866108 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-conf-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866165 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a28252b2-300b-4164-8967-7a686cce1551-kubelet-config\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.866804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866193 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd4f8689-587c-4232-b088-0d9a751ebc18-hosts-file\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866235 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-cni-bin\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866261 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-cni-netd\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866268 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cni-binary-copy\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866300 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca503c44-374a-4d1d-815e-a257a50b5684-ovn-node-metrics-cert\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866327 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-cni-bin\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866332 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4f8689-587c-4232-b088-0d9a751ebc18-tmp-dir\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866351 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40e3138-3c73-4607-881b-997cd7c41761-tmp\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866386 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-sys-fs\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866410 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-ovn\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866433 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-cni-bin\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866435 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a28252b2-300b-4164-8967-7a686cce1551-dbus\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866483 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866516 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-kubelet\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866529 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysconfig\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866548 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a28252b2-300b-4164-8967-7a686cce1551-dbus\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866575 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd4f8689-587c-4232-b088-0d9a751ebc18-hosts-file\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866575 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-sys\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.867616 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866610 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-cni-netd\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866630 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a28252b2-300b-4164-8967-7a686cce1551-kubelet-config\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866662 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-var-lib-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866668 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysctl-conf\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866685 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-sys-fs\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866691 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866712 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-kubelet\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866720 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-system-cni-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866725 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-run-ovn\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866772 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-system-cni-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866610 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ff193ad-01c5-4644-990a-635a05c8984b-multus-daemon-config\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.866800 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866814 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ff193ad-01c5-4644-990a-635a05c8984b-cni-binary-copy\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866840 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-run\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.866866 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:20:52.366843248 +0000 UTC m=+2.106755321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866878 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-run\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866893 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-systemd-units\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.868496 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866919 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-log-socket\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866949 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866978 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-cni-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867003 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-kubelet\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867025 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-modprobe-d\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867068 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-kubernetes\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867090 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysctl-d\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867112 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-systemd\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867141 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-slash\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867165 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-ovnkube-config\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867189 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6bkz\" (UniqueName: \"kubernetes.io/projected/822c5330-5f6b-4384-9675-d7f1dd971a11-kube-api-access-v6bkz\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867237 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cnibin\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867261 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-host\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867284 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-registration-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867310 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-etc-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867317 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-cni-bin\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867338 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867364 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-os-release\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.866489 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-env-overrides\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867383 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-multus-certs\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867392 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltgs\" (UniqueName: \"kubernetes.io/projected/528914bf-a508-44f0-8c49-ae2bb5dbbd90-kube-api-access-5ltgs\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867432 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-kubernetes\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867489 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-var-lib-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867490 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1185c226-3dc7-4eab-a916-edd22a0a9638-host-slash\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867532 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-socket-dir-parent\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.867563 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867568 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-lib-modules\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.867605 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:52.367590819 +0000 UTC m=+2.107502881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867601 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-var-lib-kubelet\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867638 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j92pd\" (UniqueName: \"kubernetes.io/projected/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-kube-api-access-j92pd\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867679 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-socket-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867714 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-sysctl-d\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867711 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1185c226-3dc7-4eab-a916-edd22a0a9638-iptables-alerter-script\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867765 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-systemd-units\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.869864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867785 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-systemd\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867805 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-log-socket\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867827 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-slash\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.867965 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868020 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-cnibin\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868020 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-registration-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868096 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-host\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868232 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-lib-modules\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868270 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-cni-dir\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868296 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-var-lib-kubelet\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868322 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca503c44-374a-4d1d-815e-a257a50b5684-ovnkube-config\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868352 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-etc-modprobe-d\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868396 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868580 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868405 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1185c226-3dc7-4eab-a916-edd22a0a9638-iptables-alerter-script\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868457 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/528914bf-a508-44f0-8c49-ae2bb5dbbd90-os-release\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868462 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f40e3138-3c73-4607-881b-997cd7c41761-var-lib-kubelet\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868479 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-k8s-cni-cncf-io\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870380 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868656 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-hostroot\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868682 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6pn\" (UniqueName: \"kubernetes.io/projected/6ff193ad-01c5-4644-990a-635a05c8984b-kube-api-access-bf6pn\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868707 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868732 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ff193ad-01c5-4644-990a-635a05c8984b-cni-binary-copy\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868733 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqndh\" (UniqueName: \"kubernetes.io/projected/c441402a-6cc1-4eeb-99b4-7191366c54ea-kube-api-access-dqndh\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868758 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-socket-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868774 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-run-netns\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868395 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-etc-openvswitch\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868510 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-host-run-k8s-cni-cncf-io\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868847 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca503c44-374a-4d1d-815e-a257a50b5684-host-run-netns\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868853 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-hostroot\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868886 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ff193ad-01c5-4644-990a-635a05c8984b-multus-socket-dir-parent\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868890 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1185c226-3dc7-4eab-a916-edd22a0a9638-host-slash\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.868935 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c441402a-6cc1-4eeb-99b4-7191366c54ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.869069 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/528914bf-a508-44f0-8c49-ae2bb5dbbd90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.869121 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40e3138-3c73-4607-881b-997cd7c41761-tmp\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.869751 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f89672f0-b4e2-4b38-a251-0a6f0aae67bc-agent-certs\") pod \"konnectivity-agent-st6xc\" (UID: \"f89672f0-b4e2-4b38-a251-0a6f0aae67bc\") " pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:51.870917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.869760 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca503c44-374a-4d1d-815e-a257a50b5684-ovn-node-metrics-cert\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.871424 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.870181 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f40e3138-3c73-4607-881b-997cd7c41761-etc-tuned\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.876190 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.876173 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:51.876286 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.876194 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:51.876286 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.876206 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:51.876286 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:51.876263 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:52.376248489 +0000 UTC m=+2.116160551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:51.878255 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.878235 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp92k\" (UniqueName: \"kubernetes.io/projected/1185c226-3dc7-4eab-a916-edd22a0a9638-kube-api-access-mp92k\") pod \"iptables-alerter-h2vj9\" (UID: \"1185c226-3dc7-4eab-a916-edd22a0a9638\") " pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:51.878502 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.878476 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drtxq\" (UniqueName: \"kubernetes.io/projected/bd4f8689-587c-4232-b088-0d9a751ebc18-kube-api-access-drtxq\") pod \"node-resolver-57vsp\" (UID: \"bd4f8689-587c-4232-b088-0d9a751ebc18\") " pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:51.879174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.879148 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wclwr\" (UniqueName: \"kubernetes.io/projected/ca503c44-374a-4d1d-815e-a257a50b5684-kube-api-access-wclwr\") pod \"ovnkube-node-ztks7\" (UID: \"ca503c44-374a-4d1d-815e-a257a50b5684\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:51.879846 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.879824 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6bkz\" (UniqueName: \"kubernetes.io/projected/822c5330-5f6b-4384-9675-d7f1dd971a11-kube-api-access-v6bkz\") pod \"node-ca-hs9n8\" (UID: \"822c5330-5f6b-4384-9675-d7f1dd971a11\") " pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.880386 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.880369 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqndh\" (UniqueName: \"kubernetes.io/projected/c441402a-6cc1-4eeb-99b4-7191366c54ea-kube-api-access-dqndh\") pod \"aws-ebs-csi-driver-node-c982f\" (UID: \"c441402a-6cc1-4eeb-99b4-7191366c54ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:51.880465 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.880405 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j92pd\" (UniqueName: \"kubernetes.io/projected/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-kube-api-access-j92pd\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:51.882327 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.882310 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltgs\" (UniqueName: \"kubernetes.io/projected/528914bf-a508-44f0-8c49-ae2bb5dbbd90-kube-api-access-5ltgs\") pod \"multus-additional-cni-plugins-fknl2\" (UID: \"528914bf-a508-44f0-8c49-ae2bb5dbbd90\") " pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:51.882660 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.882645 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6pn\" (UniqueName: \"kubernetes.io/projected/6ff193ad-01c5-4644-990a-635a05c8984b-kube-api-access-bf6pn\") pod \"multus-ks8kd\" (UID: \"6ff193ad-01c5-4644-990a-635a05c8984b\") " pod="openshift-multus/multus-ks8kd" Jun 03 19:20:51.882917 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.882901 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzvh\" (UniqueName: \"kubernetes.io/projected/f40e3138-3c73-4607-881b-997cd7c41761-kube-api-access-9kzvh\") pod \"tuned-ggmkj\" (UID: \"f40e3138-3c73-4607-881b-997cd7c41761\") " pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:51.982720 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:51.982644 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hs9n8" Jun 03 19:20:51.990770 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:51.990741 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822c5330_5f6b_4384_9675_d7f1dd971a11.slice/crio-196da59018f515e43d7eb17951eca91ca9234ada0d6065d1c7430865b931df37 WatchSource:0}: Error finding container 196da59018f515e43d7eb17951eca91ca9234ada0d6065d1c7430865b931df37: Status 404 returned error can't find the container with id 196da59018f515e43d7eb17951eca91ca9234ada0d6065d1c7430865b931df37 Jun 03 19:20:52.004451 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.004429 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fknl2" Jun 03 19:20:52.011976 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.011951 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528914bf_a508_44f0_8c49_ae2bb5dbbd90.slice/crio-de8c30c2497a4e6cd561d0cd103b29030a42d9a484ec580935b6c66ca2b4089d WatchSource:0}: Error finding container de8c30c2497a4e6cd561d0cd103b29030a42d9a484ec580935b6c66ca2b4089d: Status 404 returned error can't find the container with id de8c30c2497a4e6cd561d0cd103b29030a42d9a484ec580935b6c66ca2b4089d Jun 03 19:20:52.019062 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.019042 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" Jun 03 19:20:52.026088 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.026067 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40e3138_3c73_4607_881b_997cd7c41761.slice/crio-02f2a3ac704e7e1dda5d0cc2073e3f633174274e1914eade30a8b4013545cf23 WatchSource:0}: Error finding container 02f2a3ac704e7e1dda5d0cc2073e3f633174274e1914eade30a8b4013545cf23: Status 404 returned error can't find the container with id 02f2a3ac704e7e1dda5d0cc2073e3f633174274e1914eade30a8b4013545cf23 Jun 03 19:20:52.034557 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.034537 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" Jun 03 19:20:52.042774 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.042753 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc441402a_6cc1_4eeb_99b4_7191366c54ea.slice/crio-a67e88f41fd55ea59f5debd080145718268e1d8faa7ed3bc7e4e4d02fa093fb0 WatchSource:0}: Error finding container a67e88f41fd55ea59f5debd080145718268e1d8faa7ed3bc7e4e4d02fa093fb0: Status 404 returned error can't find the container with id a67e88f41fd55ea59f5debd080145718268e1d8faa7ed3bc7e4e4d02fa093fb0 Jun 03 19:20:52.051807 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.051789 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:20:52.058974 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.058945 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89672f0_b4e2_4b38_a251_0a6f0aae67bc.slice/crio-4f31a833ff7931a19384b888f8054720710bf0cc9b1875a5bc74b9bce4b37627 WatchSource:0}: Error finding container 4f31a833ff7931a19384b888f8054720710bf0cc9b1875a5bc74b9bce4b37627: Status 404 returned error can't find the container with id 4f31a833ff7931a19384b888f8054720710bf0cc9b1875a5bc74b9bce4b37627 Jun 03 19:20:52.065975 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.065959 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:20:52.072575 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.072546 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca503c44_374a_4d1d_815e_a257a50b5684.slice/crio-bb46a7670f91440fcd85c8859344f486a0043bb2e080920af73a49d6c478018b WatchSource:0}: Error finding container bb46a7670f91440fcd85c8859344f486a0043bb2e080920af73a49d6c478018b: Status 404 returned error can't find the container with id bb46a7670f91440fcd85c8859344f486a0043bb2e080920af73a49d6c478018b Jun 03 19:20:52.073218 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.073200 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h2vj9" Jun 03 19:20:52.079693 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.079555 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ks8kd" Jun 03 19:20:52.080242 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.080207 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1185c226_3dc7_4eab_a916_edd22a0a9638.slice/crio-a049d5a85fc4af4de493b6dd6f7fc69ffd5084b5596c622321fa991d7f93b1bb WatchSource:0}: Error finding container a049d5a85fc4af4de493b6dd6f7fc69ffd5084b5596c622321fa991d7f93b1bb: Status 404 returned error can't find the container with id a049d5a85fc4af4de493b6dd6f7fc69ffd5084b5596c622321fa991d7f93b1bb Jun 03 19:20:52.083960 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.083629 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57vsp" Jun 03 19:20:52.091423 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.091399 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff193ad_01c5_4644_990a_635a05c8984b.slice/crio-3c98ea74b691d9ccb91b04372a5184e182aa6aae95b80e6676de8de0ce457e28 WatchSource:0}: Error finding container 3c98ea74b691d9ccb91b04372a5184e182aa6aae95b80e6676de8de0ce457e28: Status 404 returned error can't find the container with id 3c98ea74b691d9ccb91b04372a5184e182aa6aae95b80e6676de8de0ce457e28 Jun 03 19:20:52.094178 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:20:52.094155 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4f8689_587c_4232_b088_0d9a751ebc18.slice/crio-3424115592cf4a377b52fc9b5e8f639684b107dfc0f9b65dbb1a45af819e8edb WatchSource:0}: Error finding container 3424115592cf4a377b52fc9b5e8f639684b107dfc0f9b65dbb1a45af819e8edb: Status 404 returned error can't find the container with id 3424115592cf4a377b52fc9b5e8f639684b107dfc0f9b65dbb1a45af819e8edb Jun 03 19:20:52.134821 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.134796 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:52.373046 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.372566 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:52.373046 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.372627 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:52.373046 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.372798 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:52.373046 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.372832 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:52.373046 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.372873 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:53.372852758 +0000 UTC m=+3.112764820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:52.373046 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.372899 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:20:53.372879616 +0000 UTC m=+3.112791679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:52.473512 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.473473 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:52.473695 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.473678 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:52.473695 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.473696 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:52.473810 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.473709 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:52.473810 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:52.473767 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:53.473749279 +0000 UTC m=+3.213661341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:52.498258 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.498187 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:52.702842 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.702732 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:15:51 +0000 UTC" deadline="2028-01-12 17:22:00.260782471 +0000 UTC" Jun 03 19:20:52.702842 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.702795 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h1m7.557991966s" Jun 03 19:20:52.765436 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.765248 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hs9n8" event={"ID":"822c5330-5f6b-4384-9675-d7f1dd971a11","Type":"ContainerStarted","Data":"196da59018f515e43d7eb17951eca91ca9234ada0d6065d1c7430865b931df37"} Jun 03 19:20:52.778417 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.778321 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" event={"ID":"172208cb942795fc0463350e6867edd8","Type":"ContainerStarted","Data":"7be16c19b13bb06826bb814569bcb95690ce0a2c9047cb523e9c26df4a62be30"} Jun 03 19:20:52.796672 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.796600 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ks8kd" event={"ID":"6ff193ad-01c5-4644-990a-635a05c8984b","Type":"ContainerStarted","Data":"3c98ea74b691d9ccb91b04372a5184e182aa6aae95b80e6676de8de0ce457e28"} Jun 03 19:20:52.805439 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.805342 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"bb46a7670f91440fcd85c8859344f486a0043bb2e080920af73a49d6c478018b"} Jun 03 19:20:52.815717 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.815637 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" event={"ID":"f40e3138-3c73-4607-881b-997cd7c41761","Type":"ContainerStarted","Data":"02f2a3ac704e7e1dda5d0cc2073e3f633174274e1914eade30a8b4013545cf23"} Jun 03 19:20:52.818687 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.818570 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" event={"ID":"083a0ab327601c93fa7b5b44b24c43e8","Type":"ContainerStarted","Data":"c62827b325b12e0b2d4d3e610a2ac8fdce8ab68b3122ac6cbde958a0fb060ba1"} Jun 03 19:20:52.827859 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.827750 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57vsp" event={"ID":"bd4f8689-587c-4232-b088-0d9a751ebc18","Type":"ContainerStarted","Data":"3424115592cf4a377b52fc9b5e8f639684b107dfc0f9b65dbb1a45af819e8edb"} Jun 03 19:20:52.840813 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.840780 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h2vj9" event={"ID":"1185c226-3dc7-4eab-a916-edd22a0a9638","Type":"ContainerStarted","Data":"a049d5a85fc4af4de493b6dd6f7fc69ffd5084b5596c622321fa991d7f93b1bb"} Jun 03 19:20:52.854946 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.854911 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-st6xc" event={"ID":"f89672f0-b4e2-4b38-a251-0a6f0aae67bc","Type":"ContainerStarted","Data":"4f31a833ff7931a19384b888f8054720710bf0cc9b1875a5bc74b9bce4b37627"} Jun 03 19:20:52.880772 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.880735 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" event={"ID":"c441402a-6cc1-4eeb-99b4-7191366c54ea","Type":"ContainerStarted","Data":"a67e88f41fd55ea59f5debd080145718268e1d8faa7ed3bc7e4e4d02fa093fb0"} Jun 03 19:20:52.904424 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:52.904379 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerStarted","Data":"de8c30c2497a4e6cd561d0cd103b29030a42d9a484ec580935b6c66ca2b4089d"} Jun 03 19:20:53.384301 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.383563 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:53.384301 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.383656 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:53.384301 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.383793 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:53.384301 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.383854 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:20:55.383835639 +0000 UTC m=+5.123747706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:53.384301 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.383919 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:53.384301 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.383954 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:55.383943065 +0000 UTC m=+5.123855125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:53.484541 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.484502 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:53.484714 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.484686 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:53.484714 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.484705 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:53.484825 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.484717 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:53.484825 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.484773 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:55.484755676 +0000 UTC m=+5.224667749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:53.703562 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.703407 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:15:51 +0000 UTC" deadline="2027-10-29 05:23:00.033478367 +0000 UTC" Jun 03 19:20:53.703562 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.703521 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12298h2m6.329963591s" Jun 03 19:20:53.723987 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.723958 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:53.724151 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.724101 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:20:53.724543 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.724519 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:53.724654 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.724632 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:20:53.724726 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:53.724705 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:53.724802 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:53.724784 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:20:54.144962 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:54.144880 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:54.712708 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:54.712679 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:55.403763 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:55.403729 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:55.404008 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:55.403784 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:55.404008 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.403908 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:55.404008 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.403970 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:59.403953433 +0000 UTC m=+9.143865492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:55.404429 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.404308 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:55.404429 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.404368 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:20:59.404350835 +0000 UTC m=+9.144262910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:55.504364 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:55.504328 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:55.504607 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.504585 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:55.504695 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.504613 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:55.504695 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.504627 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:55.504695 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.504690 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:59.504671432 +0000 UTC m=+9.244583494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:55.725000 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:55.724195 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:55.725000 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.724334 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:20:55.725000 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:55.724697 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:55.725000 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.724786 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:20:55.725000 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:55.724834 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:55.725000 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:55.724906 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:20:57.724194 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:57.724156 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:57.724649 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:57.724164 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:57.724649 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:57.724289 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:20:57.724649 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:57.724157 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:57.724649 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:57.724372 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:20:57.724649 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:57.724428 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:20:59.439023 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:59.438295 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:59.439023 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:59.438352 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:59.439023 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.438469 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:59.439023 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.438532 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:07.438513403 +0000 UTC m=+17.178425464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:59.439023 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.438938 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:59.439023 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.438988 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:07.438973433 +0000 UTC m=+17.178885491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:59.539445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:59.539311 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:59.539621 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.539526 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:59.539621 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.539555 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:59.539621 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.539569 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:59.539783 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.539664 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:07.539643652 +0000 UTC m=+17.279555715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:59.724676 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:59.724601 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:20:59.724676 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:59.724628 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:20:59.724902 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.724746 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:20:59.724902 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.724845 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:20:59.724902 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:20:59.724884 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:20:59.725100 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:20:59.724975 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:01.724211 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:01.724163 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:01.724211 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:01.724191 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:01.724750 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:01.724316 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:01.724750 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:01.724414 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:01.724750 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:01.724613 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:01.724750 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:01.724712 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:03.724184 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:03.724142 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:03.724610 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:03.724160 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:03.724610 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:03.724294 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:03.724610 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:03.724161 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:03.724610 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:03.724349 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:03.724610 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:03.724423 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:05.723621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:05.723580 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:05.724110 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:05.723696 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:05.724110 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:05.723708 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:05.724110 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:05.723704 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:05.724110 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:05.723816 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:05.724110 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:05.723908 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:07.496719 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:07.496687 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:07.497177 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:07.496729 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:07.497177 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.496855 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:07.497177 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.496896 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:07.497177 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.496911 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:23.496897431 +0000 UTC m=+33.236809491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:07.497177 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.496946 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:23.496932882 +0000 UTC m=+33.236844946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:07.597888 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:07.597843 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:07.598080 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.598008 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:07.598080 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.598052 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:07.598080 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.598067 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:07.598217 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.598130 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:23.59811419 +0000 UTC m=+33.338026248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:07.723624 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:07.723592 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:07.723795 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:07.723649 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:07.723795 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:07.723662 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:07.723795 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.723764 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:07.723919 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.723827 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:07.723919 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:07.723886 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:09.723845 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:09.723813 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:09.723845 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:09.723841 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:09.724290 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:09.723860 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:09.724290 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:09.723937 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:09.724290 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:09.724013 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:09.724290 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:09.724082 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:11.724158 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.723985 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:11.725020 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.723988 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:11.725020 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:11.724233 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:11.725020 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:11.724310 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:11.725020 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.724070 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:11.725020 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:11.724380 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:11.964683 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.964640 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" event={"ID":"f40e3138-3c73-4607-881b-997cd7c41761","Type":"ContainerStarted","Data":"121e80618346450e21b8fd9727ea9a9f11cba4ec4546169036241bc830426050"} Jun 03 19:21:11.966185 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.966150 2550 generic.go:356] "Generic (PLEG): container finished" podID="083a0ab327601c93fa7b5b44b24c43e8" containerID="e1da9171b221553299d4f6ac9642c33a153dd68b1ddda20f0b8ffbfd2704f5d7" exitCode=0 Jun 03 19:21:11.966297 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.966247 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" event={"ID":"083a0ab327601c93fa7b5b44b24c43e8","Type":"ContainerDied","Data":"e1da9171b221553299d4f6ac9642c33a153dd68b1ddda20f0b8ffbfd2704f5d7"} Jun 03 19:21:11.967652 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.967609 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57vsp" event={"ID":"bd4f8689-587c-4232-b088-0d9a751ebc18","Type":"ContainerStarted","Data":"4aab6d9ae03636eb13ad2c19d42c538d4a47097058403b03afab7d9d9dd9954e"} Jun 03 19:21:11.969581 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.969556 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-st6xc" event={"ID":"f89672f0-b4e2-4b38-a251-0a6f0aae67bc","Type":"ContainerStarted","Data":"533adb2cff7a66bdd7b4b6ecf5ea3e5d7faf5655aa2db2a9ddb37ee6b3e12c36"} Jun 03 19:21:11.970981 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.970958 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" event={"ID":"c441402a-6cc1-4eeb-99b4-7191366c54ea","Type":"ContainerStarted","Data":"1bcd047115a596e0d12e388fac631734b4dcd0ed35265fe117f4bd75802d29af"} Jun 03 19:21:11.972514 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.972491 2550 generic.go:356] "Generic (PLEG): container finished" podID="528914bf-a508-44f0-8c49-ae2bb5dbbd90" containerID="2f337eb74e44e49f2d8dc0430135b0d63f43121e91923264293b04445c2de66c" exitCode=0 Jun 03 19:21:11.972594 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.972550 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerDied","Data":"2f337eb74e44e49f2d8dc0430135b0d63f43121e91923264293b04445c2de66c"} Jun 03 19:21:11.973972 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.973954 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hs9n8" event={"ID":"822c5330-5f6b-4384-9675-d7f1dd971a11","Type":"ContainerStarted","Data":"f02d6191715092f9467b4c7294fd009fae2fc1a82f8e7d424342d1dc6f43abff"} Jun 03 19:21:11.975419 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.975395 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" event={"ID":"172208cb942795fc0463350e6867edd8","Type":"ContainerStarted","Data":"69d8138f16d962e6fde1f8890b9d00f13d5b03376c963c3c8f89edde2cc206a3"} Jun 03 19:21:11.977023 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.976999 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ks8kd" event={"ID":"6ff193ad-01c5-4644-990a-635a05c8984b","Type":"ContainerStarted","Data":"5e7538128a33b76427fbd5938906dbe143c3ec3d66b2960eb4d1e07cb91bd96f"} Jun 03 19:21:11.980304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.980281 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"c638d6a7fe96cc0c4787c24388ee61a62ad7d9a1625c66fd712b77285be9e08f"} Jun 03 19:21:11.980395 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.980340 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"22e1f30afd75d38921db362178afb645b459fa81baaf257a0b1e0b81c3a0d617"} Jun 03 19:21:11.980395 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.980371 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"6bdf19ac1ce94aba450d045300b018ca3c1442136291cc91ff5fc4132445d4cb"} Jun 03 19:21:11.980461 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.980398 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"09621aa5354dc6661a429994f078edd4b093a071988c328762119e5c780f7666"} Jun 03 19:21:11.980461 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.980424 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"9224dfd4ea39491d13d624347369801272edeaf74977c16c43dcb074c1e80677"} Jun 03 19:21:11.980461 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.980450 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"7dd39a6680296e88c33e44236a4b7caeba36164859c49a58278829d8cbc6b3e6"} Jun 03 19:21:11.984192 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:11.984148 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ggmkj" podStartSLOduration=2.926483352 podStartE2EDuration="21.984136929s" totalImagesPullingTime="19.057653577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:11.98409343 +0000 UTC m=+21.724005543" watchObservedRunningTime="2026-06-03 19:21:11.984136929 +0000 UTC m=+21.724049010" Jun 03 19:21:12.000795 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.000756 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-st6xc" podStartSLOduration=1.976023411 podStartE2EDuration="21.000743694s" totalImagesPullingTime="19.024720283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:12.000510528 +0000 UTC m=+21.740422636" watchObservedRunningTime="2026-06-03 19:21:12.000743694 +0000 UTC m=+21.740655775" Jun 03 19:21:12.047218 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.047164 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ks8kd" podStartSLOduration=1.852293505 podStartE2EDuration="21.047148866s" totalImagesPullingTime="19.194855361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:12.047106857 +0000 UTC m=+21.787018937" watchObservedRunningTime="2026-06-03 19:21:12.047148866 +0000 UTC m=+21.787060948" Jun 03 19:21:12.047460 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.047435 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-220.ec2.internal" podStartSLOduration=21.047429931 podStartE2EDuration="21.047429931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:12.022518171 +0000 UTC m=+21.762430251" watchObservedRunningTime="2026-06-03 19:21:12.047429931 +0000 UTC m=+21.787342012" Jun 03 19:21:12.081457 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.081408 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-57vsp" podStartSLOduration=2.345345969 podStartE2EDuration="21.081393531s" totalImagesPullingTime="18.736047562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:12.063091823 +0000 UTC m=+21.803003917" watchObservedRunningTime="2026-06-03 19:21:12.081393531 +0000 UTC m=+21.821305612" Jun 03 19:21:12.081627 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.081491 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hs9n8" podStartSLOduration=2.98872647 podStartE2EDuration="22.081481071s" totalImagesPullingTime="19.092754601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:12.081010696 +0000 UTC m=+21.820922810" watchObservedRunningTime="2026-06-03 19:21:12.081481071 +0000 UTC m=+21.821393154" Jun 03 19:21:12.299884 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.299848 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:21:12.300595 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.300567 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:21:12.985161 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.985125 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h2vj9" event={"ID":"1185c226-3dc7-4eab-a916-edd22a0a9638","Type":"ContainerStarted","Data":"0f4b89f4985dccf31c550a2d9f26830277c8db9f15fb353297e2db82b2ada114"} Jun 03 19:21:12.992696 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:12.992670 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:21:13.003382 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.003316 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h2vj9" podStartSLOduration=2.980923458 podStartE2EDuration="22.00329646s" totalImagesPullingTime="19.022373002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:13.002440555 +0000 UTC m=+22.742352666" watchObservedRunningTime="2026-06-03 19:21:13.00329646 +0000 UTC m=+22.743208542" Jun 03 19:21:13.723935 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.723897 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:13.723935 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.723935 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:13.724286 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.723897 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:13.724286 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:13.724021 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:13.724286 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:13.724145 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:13.724286 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:13.724255 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:13.725983 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.725901 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:21:12.992692089Z","UUID":"2a212293-a873-4c72-95df-20f9ee7c8736","Handler":null,"Name":"","Endpoint":""} Jun 03 19:21:13.727460 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.727438 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:21:13.727561 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.727474 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:21:13.991471 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.991441 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" event={"ID":"c441402a-6cc1-4eeb-99b4-7191366c54ea","Type":"ContainerStarted","Data":"411f72350600c64ecb320127b5430934b9a9051c8cbac5555d4faf084a2851ea"} Jun 03 19:21:13.993627 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.993597 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" event={"ID":"083a0ab327601c93fa7b5b44b24c43e8","Type":"ContainerStarted","Data":"4ea3b097cb6516574a04ecfa4f1f8e2ef46bd0ef98df912c69ae12d7c430c0e6"} Jun 03 19:21:13.993742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:13.993641 2550 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 19:21:14.011486 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:14.011439 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-220.ec2.internal" podStartSLOduration=23.011425052 podStartE2EDuration="23.011425052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:14.010936908 +0000 UTC m=+23.750849002" watchObservedRunningTime="2026-06-03 19:21:14.011425052 +0000 UTC m=+23.751337133" Jun 03 19:21:14.998286 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:14.997943 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" event={"ID":"c441402a-6cc1-4eeb-99b4-7191366c54ea","Type":"ContainerStarted","Data":"d57ef7d8c9cba165f1369224febd70b61824e8e2e7a2d786c0d4195491dff063"} Jun 03 19:21:15.001516 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:15.001482 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"dbfc89aa9ab93a8e4f701e86417b038eff2d2d2f39fcb1f44283705192e3753b"} Jun 03 19:21:15.020463 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:15.020408 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c982f" podStartSLOduration=3.9959561409999997 podStartE2EDuration="25.020390992s" totalImagesPullingTime="21.024434851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:15.019733684 +0000 UTC m=+24.759645768" watchObservedRunningTime="2026-06-03 19:21:15.020390992 +0000 UTC m=+24.760303073" Jun 03 19:21:15.724179 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:15.724143 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:15.724340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:15.724150 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:15.724340 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:15.724262 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:15.724340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:15.724274 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:15.724489 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:15.724375 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:15.724489 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:15.724461 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:17.006674 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.006469 2550 generic.go:356] "Generic (PLEG): container finished" podID="528914bf-a508-44f0-8c49-ae2bb5dbbd90" containerID="2a30df16199d4b19749f17a11cd369476789b7904e0e59c9b346c60d409ad9f7" exitCode=0 Jun 03 19:21:17.007516 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.006547 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerDied","Data":"2a30df16199d4b19749f17a11cd369476789b7904e0e59c9b346c60d409ad9f7"} Jun 03 19:21:17.010500 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.010476 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" event={"ID":"ca503c44-374a-4d1d-815e-a257a50b5684","Type":"ContainerStarted","Data":"96b0d17330e4bcc1ee7914fa36a54256e16a7075b400a317a34479c065de6067"} Jun 03 19:21:17.010724 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.010697 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:21:17.010814 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.010759 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:21:17.026432 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.026404 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:21:17.075196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.075141 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" podStartSLOduration=6.993387179 podStartE2EDuration="26.075125796s" totalImagesPullingTime="19.081738617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:17.074617204 +0000 UTC m=+26.814529287" watchObservedRunningTime="2026-06-03 19:21:17.075125796 +0000 UTC m=+26.815037876" Jun 03 19:21:17.546570 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.546529 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:21:17.546791 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.546735 2550 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 19:21:17.547129 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.547110 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-st6xc" Jun 03 19:21:17.723868 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.723839 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:17.724058 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.723907 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:17.724058 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:17.724010 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:17.724134 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:17.724026 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:17.724134 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:17.724100 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:17.724197 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:17.724178 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:18.015645 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.015620 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:21:18.031692 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.031669 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:21:18.218062 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.217972 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mnv9"] Jun 03 19:21:18.218212 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.218082 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:18.218212 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:18.218195 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:18.220531 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.220508 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rvs9p"] Jun 03 19:21:18.220647 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.220578 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:18.220707 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:18.220654 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:18.223674 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.223655 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25zwz"] Jun 03 19:21:18.223758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:18.223726 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:18.223809 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:18.223794 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:19.019895 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:19.019857 2550 generic.go:356] "Generic (PLEG): container finished" podID="528914bf-a508-44f0-8c49-ae2bb5dbbd90" containerID="b727886a14878915510c20a9f259d4cc99c1ac62c4341f5e6e3fb3f223fa139d" exitCode=0 Jun 03 19:21:19.020338 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:19.019951 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerDied","Data":"b727886a14878915510c20a9f259d4cc99c1ac62c4341f5e6e3fb3f223fa139d"} Jun 03 19:21:19.723870 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:19.723830 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:19.724088 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:19.723889 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:19.724088 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:19.723943 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:19.724088 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:19.723960 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:19.724253 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:19.724079 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:19.724253 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:19.724219 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:21.029829 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:21.029648 2550 generic.go:356] "Generic (PLEG): container finished" podID="528914bf-a508-44f0-8c49-ae2bb5dbbd90" containerID="5e547b4c5fdbafe05c2e94de7f8965cfa4a8a3b98da8495cd8a0890bc11955d9" exitCode=0 Jun 03 19:21:21.029829 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:21.029733 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerDied","Data":"5e547b4c5fdbafe05c2e94de7f8965cfa4a8a3b98da8495cd8a0890bc11955d9"} Jun 03 19:21:21.724232 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:21.724198 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:21.724420 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:21.724239 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:21.724420 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:21.724200 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:21.724420 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:21.724323 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:21.724550 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:21.724426 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:21.724550 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:21.724477 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:23.513342 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:23.513299 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:23.513967 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:23.513357 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:23.513967 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.513482 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:23.513967 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.513557 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret podName:a28252b2-300b-4164-8967-7a686cce1551 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:55.513535301 +0000 UTC m=+65.253447378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret") pod "global-pull-secret-syncer-9mnv9" (UID: "a28252b2-300b-4164-8967-7a686cce1551") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:23.513967 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.513482 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:23.513967 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.513653 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:21:55.513631784 +0000 UTC m=+65.253543854 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:23.613758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:23.613727 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:23.613934 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.613870 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:23.613934 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.613887 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:23.613934 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.613899 2550 projected.go:196] Error preparing data for projected volume kube-api-access-pk6gp for pod openshift-network-diagnostics/network-check-target-rvs9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:23.614093 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.613958 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp podName:1b24056a-e44a-4fa3-a5df-a1ca23a4df18 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:55.61394459 +0000 UTC m=+65.353856649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pk6gp" (UniqueName: "kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp") pod "network-check-target-rvs9p" (UID: "1b24056a-e44a-4fa3-a5df-a1ca23a4df18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:23.724102 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:23.724066 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:23.724265 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:23.724066 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:23.724265 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.724177 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvs9p" podUID="1b24056a-e44a-4fa3-a5df-a1ca23a4df18" Jun 03 19:21:23.724265 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:23.724074 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:23.724265 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.724246 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:21:23.724433 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:23.724361 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mnv9" podUID="a28252b2-300b-4164-8967-7a686cce1551" Jun 03 19:21:25.042153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.041888 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerStarted","Data":"59ed75a3ba617cf4df23cdd7fb0a155886b1f2872956711480901b7540eaac5c"} Jun 03 19:21:25.116343 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.116318 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-220.ec2.internal" event="NodeReady" Jun 03 19:21:25.116484 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.116474 2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:21:25.181950 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.181919 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5985f9dcfc-r4qct"] Jun 03 19:21:25.184692 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.184675 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.188201 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.188177 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:21:25.188201 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.188191 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:21:25.188389 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.188185 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wcxmw\"" Jun 03 19:21:25.188389 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.188258 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:21:25.196021 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.195993 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:21:25.207241 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.207215 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5985f9dcfc-r4qct"] Jun 03 19:21:25.208977 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.208953 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kj7fg"] Jun 03 19:21:25.211884 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.211866 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6gxxk"] Jun 03 19:21:25.211998 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.211979 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.214728 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.214711 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.215454 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.215432 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:21:25.215738 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.215727 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzqw4\"" Jun 03 19:21:25.215988 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.215976 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:21:25.216474 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.216462 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:21:25.219398 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.219380 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:21:25.219529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.219455 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfxzd\"" Jun 03 19:21:25.219843 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.219726 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:21:25.220489 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.220468 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kj7fg"] Jun 03 19:21:25.223816 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.223794 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gxxk"] Jun 03 19:21:25.325994 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.325889 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-certificates\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.325994 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.325934 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.325994 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.325959 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-trusted-ca\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.325994 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.325983 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slfxf\" (UniqueName: \"kubernetes.io/projected/14ba38e0-2bdf-465a-a42b-396462d66803-kube-api-access-slfxf\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326048 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da0da4ac-1b5d-467a-af7e-c49fb050839c-ca-trust-extracted\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326072 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9w5z\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-kube-api-access-n9w5z\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326101 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-bound-sa-token\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326115 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6eeeeef9-9080-408c-9c37-9ba54440b411-cert\") pod \"ingress-canary-kj7fg\" (UID: \"6eeeeef9-9080-408c-9c37-9ba54440b411\") " pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326150 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14ba38e0-2bdf-465a-a42b-396462d66803-config-volume\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-image-registry-private-configuration\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326265 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.326331 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326292 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twdlh\" (UniqueName: \"kubernetes.io/projected/6eeeeef9-9080-408c-9c37-9ba54440b411-kube-api-access-twdlh\") pod \"ingress-canary-kj7fg\" (UID: \"6eeeeef9-9080-408c-9c37-9ba54440b411\") " pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.326709 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326335 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-installation-pull-secrets\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.326709 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.326368 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ba38e0-2bdf-465a-a42b-396462d66803-tmp-dir\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.426635 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426599 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14ba38e0-2bdf-465a-a42b-396462d66803-config-volume\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.426826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426652 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-image-registry-private-configuration\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.426826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426677 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.426826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426697 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twdlh\" (UniqueName: \"kubernetes.io/projected/6eeeeef9-9080-408c-9c37-9ba54440b411-kube-api-access-twdlh\") pod \"ingress-canary-kj7fg\" (UID: \"6eeeeef9-9080-408c-9c37-9ba54440b411\") " pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.426826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426733 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-installation-pull-secrets\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.426826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426753 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ba38e0-2bdf-465a-a42b-396462d66803-tmp-dir\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.426826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426781 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-certificates\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.426824 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.426846 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.426887 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.426917 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:25.926895653 +0000 UTC m=+35.666807714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.426936 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:25.92692659 +0000 UTC m=+35.666838654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.426825 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427094 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ba38e0-2bdf-465a-a42b-396462d66803-tmp-dir\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427131 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-trusted-ca\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.427170 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427162 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slfxf\" (UniqueName: \"kubernetes.io/projected/14ba38e0-2bdf-465a-a42b-396462d66803-kube-api-access-slfxf\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427215 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da0da4ac-1b5d-467a-af7e-c49fb050839c-ca-trust-extracted\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427241 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9w5z\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-kube-api-access-n9w5z\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427295 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-bound-sa-token\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427307 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14ba38e0-2bdf-465a-a42b-396462d66803-config-volume\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427319 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6eeeeef9-9080-408c-9c37-9ba54440b411-cert\") pod \"ingress-canary-kj7fg\" (UID: \"6eeeeef9-9080-408c-9c37-9ba54440b411\") " pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427408 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-certificates\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.427640 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.427555 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da0da4ac-1b5d-467a-af7e-c49fb050839c-ca-trust-extracted\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.428161 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.428136 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-trusted-ca\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.431065 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.431024 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6eeeeef9-9080-408c-9c37-9ba54440b411-cert\") pod \"ingress-canary-kj7fg\" (UID: \"6eeeeef9-9080-408c-9c37-9ba54440b411\") " pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.431157 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.431061 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-image-registry-private-configuration\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.431157 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.431063 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-installation-pull-secrets\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.437970 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.437938 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twdlh\" (UniqueName: \"kubernetes.io/projected/6eeeeef9-9080-408c-9c37-9ba54440b411-kube-api-access-twdlh\") pod \"ingress-canary-kj7fg\" (UID: \"6eeeeef9-9080-408c-9c37-9ba54440b411\") " pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.438492 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.438468 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slfxf\" (UniqueName: \"kubernetes.io/projected/14ba38e0-2bdf-465a-a42b-396462d66803-kube-api-access-slfxf\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.438665 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.438574 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-bound-sa-token\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.439088 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.439073 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9w5z\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-kube-api-access-n9w5z\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.522642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.522597 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kj7fg" Jun 03 19:21:25.674416 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.674394 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kj7fg"] Jun 03 19:21:25.676999 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:21:25.676969 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeeeef9_9080_408c_9c37_9ba54440b411.slice/crio-8d7b2f6bb01c4e4cd0d8c83721c4beddf0cae359ed6ba9bb1b7c348a8f6467fe WatchSource:0}: Error finding container 8d7b2f6bb01c4e4cd0d8c83721c4beddf0cae359ed6ba9bb1b7c348a8f6467fe: Status 404 returned error can't find the container with id 8d7b2f6bb01c4e4cd0d8c83721c4beddf0cae359ed6ba9bb1b7c348a8f6467fe Jun 03 19:21:25.723647 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.723614 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:25.723647 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.723641 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:25.723896 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.723793 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:25.727212 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.727188 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:21:25.727351 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.727230 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pf7v\"" Jun 03 19:21:25.727351 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.727298 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:21:25.728651 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.728636 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-grwp9\"" Jun 03 19:21:25.728884 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.728869 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:21:25.728955 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.728923 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:21:25.931500 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.931467 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:25.931666 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:25.931517 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:25.931666 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.931621 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:25.931666 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.931624 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:25.931666 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.931643 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:25.931786 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.931677 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:26.931661347 +0000 UTC m=+36.671573407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:25.931786 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:25.931691 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:26.931684595 +0000 UTC m=+36.671596654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:21:26.044953 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:26.044918 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kj7fg" event={"ID":"6eeeeef9-9080-408c-9c37-9ba54440b411","Type":"ContainerStarted","Data":"8d7b2f6bb01c4e4cd0d8c83721c4beddf0cae359ed6ba9bb1b7c348a8f6467fe"} Jun 03 19:21:26.047600 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:26.047568 2550 generic.go:356] "Generic (PLEG): container finished" podID="528914bf-a508-44f0-8c49-ae2bb5dbbd90" containerID="59ed75a3ba617cf4df23cdd7fb0a155886b1f2872956711480901b7540eaac5c" exitCode=0 Jun 03 19:21:26.047725 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:26.047618 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerDied","Data":"59ed75a3ba617cf4df23cdd7fb0a155886b1f2872956711480901b7540eaac5c"} Jun 03 19:21:26.938538 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:26.938369 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:26.938538 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:26.938528 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:26.938722 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:26.938594 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:28.938577566 +0000 UTC m=+38.678489646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:26.938722 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:26.938614 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:26.938797 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:26.938724 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:26.938797 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:26.938737 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:26.938797 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:26.938779 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:28.938767443 +0000 UTC m=+38.678679506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:21:27.053812 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:27.053778 2550 generic.go:356] "Generic (PLEG): container finished" podID="528914bf-a508-44f0-8c49-ae2bb5dbbd90" containerID="0f506f5ae25b348ed5ddf697d96b8a3f1ba499e580c4f99799215aa42931c098" exitCode=0 Jun 03 19:21:27.054240 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:27.053848 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerDied","Data":"0f506f5ae25b348ed5ddf697d96b8a3f1ba499e580c4f99799215aa42931c098"} Jun 03 19:21:28.059937 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:28.059853 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fknl2" event={"ID":"528914bf-a508-44f0-8c49-ae2bb5dbbd90","Type":"ContainerStarted","Data":"72367f9b131bfc5157672b37177a87f361223cf0b4894ec2a7dfdfae002ac939"} Jun 03 19:21:28.086798 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:28.086738 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fknl2" podStartSLOduration=9.088790421 podStartE2EDuration="38.086716713s" totalImagesPullingTime="28.997926292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:28.084402508 +0000 UTC m=+37.824314589" watchObservedRunningTime="2026-06-03 19:21:28.086716713 +0000 UTC m=+37.826628796" Jun 03 19:21:28.954439 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:28.954390 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:28.954439 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:28.954440 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:28.954686 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:28.954538 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:28.954686 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:28.954553 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:28.954686 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:28.954576 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:28.954686 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:28.954589 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:32.954576127 +0000 UTC m=+42.694488186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:28.954686 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:28.954631 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:32.954615856 +0000 UTC m=+42.694527918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:21:29.064670 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:29.064634 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kj7fg" event={"ID":"6eeeeef9-9080-408c-9c37-9ba54440b411","Type":"ContainerStarted","Data":"79a40f3f4e2f6be61129c7b0e9752f4d63f263e2f50103a7658cc44e0b1a8a3e"} Jun 03 19:21:29.090188 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:29.090074 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kj7fg" podStartSLOduration=0.949092712 podStartE2EDuration="4.090057444s" totalImagesPullingTime="3.140964732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:29.088514479 +0000 UTC m=+38.828426560" watchObservedRunningTime="2026-06-03 19:21:29.090057444 +0000 UTC m=+38.829969519" Jun 03 19:21:32.985471 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:32.985432 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:32.985878 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:32.985490 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:32.985878 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:32.985578 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:32.985878 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:32.985606 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:32.985878 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:32.985629 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:32.985878 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:32.985638 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:40.985622357 +0000 UTC m=+50.725534418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:32.985878 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:32.985681 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:40.985668991 +0000 UTC m=+50.725581053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:21:34.273740 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.273702 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn"] Jun 03 19:21:34.300587 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.300559 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn"] Jun 03 19:21:34.300742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.300669 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.304747 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.304719 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:21:34.304747 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.304744 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:21:34.304942 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.304754 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:21:34.306118 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.306098 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 19:21:34.396168 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.396122 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ec6a577-6091-40f0-b84e-58416906d041-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.396168 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.396170 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ec6a577-6091-40f0-b84e-58416906d041-tmp\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.396397 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.396260 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/5ec6a577-6091-40f0-b84e-58416906d041-kube-api-access-z4tpm\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.496896 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.496859 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/5ec6a577-6091-40f0-b84e-58416906d041-kube-api-access-z4tpm\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.497011 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.496948 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ec6a577-6091-40f0-b84e-58416906d041-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.497011 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.496968 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ec6a577-6091-40f0-b84e-58416906d041-tmp\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.497315 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.497297 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ec6a577-6091-40f0-b84e-58416906d041-tmp\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.500607 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.500584 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ec6a577-6091-40f0-b84e-58416906d041-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.505889 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.505864 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/5ec6a577-6091-40f0-b84e-58416906d041-kube-api-access-z4tpm\") pod \"klusterlet-addon-workmgr-5bccd7ffb7-hmdtn\" (UID: \"5ec6a577-6091-40f0-b84e-58416906d041\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.613101 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.613068 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:34.747693 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:34.747640 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn"] Jun 03 19:21:34.750258 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:21:34.750229 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec6a577_6091_40f0_b84e_58416906d041.slice/crio-e277f0ee1194fc83f071c85a76466a78af40678343eaa0d7934728e4e2d8dfbd WatchSource:0}: Error finding container e277f0ee1194fc83f071c85a76466a78af40678343eaa0d7934728e4e2d8dfbd: Status 404 returned error can't find the container with id e277f0ee1194fc83f071c85a76466a78af40678343eaa0d7934728e4e2d8dfbd Jun 03 19:21:35.079670 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:35.079578 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" event={"ID":"5ec6a577-6091-40f0-b84e-58416906d041","Type":"ContainerStarted","Data":"e277f0ee1194fc83f071c85a76466a78af40678343eaa0d7934728e4e2d8dfbd"} Jun 03 19:21:40.094546 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:40.094505 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" event={"ID":"5ec6a577-6091-40f0-b84e-58416906d041","Type":"ContainerStarted","Data":"85e117c961fbb648ac7b7c7dc8ea9d965f98f68640aee2b3ff3cf7ef8120da05"} Jun 03 19:21:40.094940 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:40.094813 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:40.096317 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:40.096297 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:21:40.115470 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:40.115426 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" podStartSLOduration=1.279096794 podStartE2EDuration="6.115411523s" totalImagesPullingTime="4.836314729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:40.114393808 +0000 UTC m=+49.854305889" watchObservedRunningTime="2026-06-03 19:21:40.115411523 +0000 UTC m=+49.855323603" Jun 03 19:21:41.042530 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:41.042487 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:41.042530 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:41.042536 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:41.042743 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:41.042628 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:41.042743 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:41.042631 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:41.042743 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:41.042653 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:41.042743 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:41.042677 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:57.04266443 +0000 UTC m=+66.782576489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:41.042743 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:41.042695 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:57.042682956 +0000 UTC m=+66.782595014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:21:50.042626 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:50.042595 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztks7" Jun 03 19:21:55.547626 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.547573 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:55.548079 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.547773 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:21:55.551215 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.551198 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:21:55.551266 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.551231 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:21:55.558023 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:55.558008 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:21:55.558091 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:55.558080 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:22:59.558060393 +0000 UTC m=+129.297972455 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : secret "metrics-daemon-secret" not found Jun 03 19:21:55.560260 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.560237 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a28252b2-300b-4164-8967-7a686cce1551-original-pull-secret\") pod \"global-pull-secret-syncer-9mnv9\" (UID: \"a28252b2-300b-4164-8967-7a686cce1551\") " pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:55.648564 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.648532 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:55.652337 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.652320 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:21:55.662594 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.662575 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:21:55.672248 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.672225 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6gp\" (UniqueName: \"kubernetes.io/projected/1b24056a-e44a-4fa3-a5df-a1ca23a4df18-kube-api-access-pk6gp\") pod \"network-check-target-rvs9p\" (UID: \"1b24056a-e44a-4fa3-a5df-a1ca23a4df18\") " pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:55.739932 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.739908 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mnv9" Jun 03 19:21:55.749286 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.749269 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pf7v\"" Jun 03 19:21:55.755318 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.755297 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:21:55.868736 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.868701 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mnv9"] Jun 03 19:21:55.871123 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:21:55.871089 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28252b2_300b_4164_8967_7a686cce1551.slice/crio-879bc263b54592592a4eb4915a86307d2f2ae55f897fd8f7c72488c6550db703 WatchSource:0}: Error finding container 879bc263b54592592a4eb4915a86307d2f2ae55f897fd8f7c72488c6550db703: Status 404 returned error can't find the container with id 879bc263b54592592a4eb4915a86307d2f2ae55f897fd8f7c72488c6550db703 Jun 03 19:21:55.882864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:55.882846 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rvs9p"] Jun 03 19:21:55.884800 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:21:55.884777 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b24056a_e44a_4fa3_a5df_a1ca23a4df18.slice/crio-2e3df8259549a7265513d632820639c4a19d0b48032cac43eb235eacc9ec1ec1 WatchSource:0}: Error finding container 2e3df8259549a7265513d632820639c4a19d0b48032cac43eb235eacc9ec1ec1: Status 404 returned error can't find the container with id 2e3df8259549a7265513d632820639c4a19d0b48032cac43eb235eacc9ec1ec1 Jun 03 19:21:56.133385 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:56.133354 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mnv9" event={"ID":"a28252b2-300b-4164-8967-7a686cce1551","Type":"ContainerStarted","Data":"879bc263b54592592a4eb4915a86307d2f2ae55f897fd8f7c72488c6550db703"} Jun 03 19:21:56.134397 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:56.134375 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rvs9p" event={"ID":"1b24056a-e44a-4fa3-a5df-a1ca23a4df18","Type":"ContainerStarted","Data":"2e3df8259549a7265513d632820639c4a19d0b48032cac43eb235eacc9ec1ec1"} Jun 03 19:21:57.061284 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:57.061245 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:21:57.061769 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:21:57.061305 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:21:57.061769 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:57.061460 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:57.061769 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:57.061521 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:22:29.061502997 +0000 UTC m=+98.801415076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:21:57.061952 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:57.061854 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:21:57.061952 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:57.061877 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:21:57.061952 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:21:57.061942 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:22:29.061924817 +0000 UTC m=+98.801836877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:22:01.149702 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:01.149660 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rvs9p" event={"ID":"1b24056a-e44a-4fa3-a5df-a1ca23a4df18","Type":"ContainerStarted","Data":"5d8d1b843d589d38b423c0e88a83f01bd3766b844ac45bd2f96faeef3660bed2"} Jun 03 19:22:01.150309 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:01.149789 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:22:01.151107 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:01.151088 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mnv9" event={"ID":"a28252b2-300b-4164-8967-7a686cce1551","Type":"ContainerStarted","Data":"747a7fe94e0d37d7a2c236a3cc6b9a38965ae7ee3c523301cf3e653a6421ab6d"} Jun 03 19:22:01.176107 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:01.176014 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rvs9p" podStartSLOduration=65.538059709 podStartE2EDuration="1m10.176001351s" totalImagesPullingTime="4.637941642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:22:01.175611671 +0000 UTC m=+70.915523752" watchObservedRunningTime="2026-06-03 19:22:01.176001351 +0000 UTC m=+70.915913431" Jun 03 19:22:01.213386 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:01.213338 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9mnv9" podStartSLOduration=65.556552341 podStartE2EDuration="1m10.213321664s" totalImagesPullingTime="4.656769323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:22:01.212833245 +0000 UTC m=+70.952745327" watchObservedRunningTime="2026-06-03 19:22:01.213321664 +0000 UTC m=+70.953233745" Jun 03 19:22:29.085073 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:29.085013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:22:29.085073 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:29.085077 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:22:29.085593 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:29.085184 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:22:29.085593 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:29.085185 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:22:29.085593 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:29.085208 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:22:29.085593 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:29.085245 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:23:33.085230311 +0000 UTC m=+162.825142369 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:22:29.085593 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:29.085276 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:23:33.085258923 +0000 UTC m=+162.825170983 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:22:32.155846 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:32.155812 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rvs9p" Jun 03 19:22:59.600545 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:22:59.600506 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:22:59.601057 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:59.600659 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:22:59.601057 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:22:59.600751 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:25:01.600735569 +0000 UTC m=+251.340647628 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : secret "metrics-daemon-secret" not found Jun 03 19:23:28.193736 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:28.193681 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" Jun 03 19:23:28.229125 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:28.229081 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6gxxk" podUID="14ba38e0-2bdf-465a-a42b-396462d66803" Jun 03 19:23:28.358449 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:28.358419 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:23:28.358592 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:28.358422 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gxxk" Jun 03 19:23:28.733867 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:28.733835 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:23:33.136735 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:33.136677 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:23:33.136735 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:33.136744 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:23:33.137280 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:33.136845 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:23:33.137280 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:33.136862 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:23:33.137280 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:33.136865 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f9dcfc-r4qct: secret "image-registry-tls" not found Jun 03 19:23:33.137280 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:33.136925 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls podName:14ba38e0-2bdf-465a-a42b-396462d66803 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:35.13691023 +0000 UTC m=+284.876822292 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls") pod "dns-default-6gxxk" (UID: "14ba38e0-2bdf-465a-a42b-396462d66803") : secret "dns-default-metrics-tls" not found Jun 03 19:23:33.137280 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:23:33.136939 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls podName:da0da4ac-1b5d-467a-af7e-c49fb050839c nodeName:}" failed. No retries permitted until 2026-06-03 19:25:35.136933767 +0000 UTC m=+284.876845826 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls") pod "image-registry-5985f9dcfc-r4qct" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c") : secret "image-registry-tls" not found Jun 03 19:23:40.095925 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:40.095823 2550 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" podUID="5ec6a577-6091-40f0-b84e-58416906d041" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 03 19:23:40.386754 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:40.386719 2550 generic.go:356] "Generic (PLEG): container finished" podID="5ec6a577-6091-40f0-b84e-58416906d041" containerID="85e117c961fbb648ac7b7c7dc8ea9d965f98f68640aee2b3ff3cf7ef8120da05" exitCode=1 Jun 03 19:23:40.386914 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:40.386784 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" event={"ID":"5ec6a577-6091-40f0-b84e-58416906d041","Type":"ContainerDied","Data":"85e117c961fbb648ac7b7c7dc8ea9d965f98f68640aee2b3ff3cf7ef8120da05"} Jun 03 19:23:40.387137 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:40.387121 2550 scope.go:117] "RemoveContainer" containerID="85e117c961fbb648ac7b7c7dc8ea9d965f98f68640aee2b3ff3cf7ef8120da05" Jun 03 19:23:40.725313 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:40.725225 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:23:41.390941 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:41.390900 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" event={"ID":"5ec6a577-6091-40f0-b84e-58416906d041","Type":"ContainerStarted","Data":"fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e"} Jun 03 19:23:41.391372 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:41.391172 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:23:41.391710 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:23:41.391692 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:25:01.664836 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:01.664786 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:25:01.665333 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:01.664927 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:25:01.665333 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:01.664997 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs podName:b6b625c0-e0f2-44b3-b858-7d26d8a2746f nodeName:}" failed. No retries permitted until 2026-06-03 19:27:03.664978602 +0000 UTC m=+373.404890665 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs") pod "network-metrics-daemon-25zwz" (UID: "b6b625c0-e0f2-44b3-b858-7d26d8a2746f") : secret "metrics-daemon-secret" not found Jun 03 19:25:12.449154 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.449072 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z"] Jun 03 19:25:12.451904 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.451883 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" Jun 03 19:25:12.453256 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.453229 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5"] Jun 03 19:25:12.455103 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.455086 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pgrmd\"" Jun 03 19:25:12.455844 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.455830 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.458942 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.458926 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.459014 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.458989 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6rwdw\"" Jun 03 19:25:12.459078 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.459023 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 19:25:12.459288 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.459272 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 19:25:12.460216 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.460200 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.478618 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.478589 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z"] Jun 03 19:25:12.493439 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.493409 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5"] Jun 03 19:25:12.537272 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.537232 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk866\" (UniqueName: \"kubernetes.io/projected/6add7c70-6d87-4784-b4c5-2a0771be28d0-kube-api-access-sk866\") pod \"network-check-source-dbd9cf844-wtw8z\" (UID: \"6add7c70-6d87-4784-b4c5-2a0771be28d0\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" Jun 03 19:25:12.537272 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.537276 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ada238-a0b8-4e63-ac69-b978c0e8a48f-serving-cert\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.537482 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.537354 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ada238-a0b8-4e63-ac69-b978c0e8a48f-config\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.537482 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.537388 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq9l6\" (UniqueName: \"kubernetes.io/projected/55ada238-a0b8-4e63-ac69-b978c0e8a48f-kube-api-access-dq9l6\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.638369 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.638332 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ada238-a0b8-4e63-ac69-b978c0e8a48f-config\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.638565 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.638391 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq9l6\" (UniqueName: \"kubernetes.io/projected/55ada238-a0b8-4e63-ac69-b978c0e8a48f-kube-api-access-dq9l6\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.638565 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.638432 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk866\" (UniqueName: \"kubernetes.io/projected/6add7c70-6d87-4784-b4c5-2a0771be28d0-kube-api-access-sk866\") pod \"network-check-source-dbd9cf844-wtw8z\" (UID: \"6add7c70-6d87-4784-b4c5-2a0771be28d0\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" Jun 03 19:25:12.638565 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.638465 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ada238-a0b8-4e63-ac69-b978c0e8a48f-serving-cert\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.638871 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.638845 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ada238-a0b8-4e63-ac69-b978c0e8a48f-config\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.640622 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.640602 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ada238-a0b8-4e63-ac69-b978c0e8a48f-serving-cert\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.655463 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.655433 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk866\" (UniqueName: \"kubernetes.io/projected/6add7c70-6d87-4784-b4c5-2a0771be28d0-kube-api-access-sk866\") pod \"network-check-source-dbd9cf844-wtw8z\" (UID: \"6add7c70-6d87-4784-b4c5-2a0771be28d0\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" Jun 03 19:25:12.655845 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.655825 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq9l6\" (UniqueName: \"kubernetes.io/projected/55ada238-a0b8-4e63-ac69-b978c0e8a48f-kube-api-access-dq9l6\") pod \"service-ca-operator-5bc4cf794b-wplq5\" (UID: \"55ada238-a0b8-4e63-ac69-b978c0e8a48f\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.761779 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.761673 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" Jun 03 19:25:12.766678 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.766661 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" Jun 03 19:25:12.889079 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.889027 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5"] Jun 03 19:25:12.891482 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:12.891456 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ada238_a0b8_4e63_ac69_b978c0e8a48f.slice/crio-313565e539b8bd727ae3b31dff8ad5223cd431a34da3550779d98cb1fd9a71eb WatchSource:0}: Error finding container 313565e539b8bd727ae3b31dff8ad5223cd431a34da3550779d98cb1fd9a71eb: Status 404 returned error can't find the container with id 313565e539b8bd727ae3b31dff8ad5223cd431a34da3550779d98cb1fd9a71eb Jun 03 19:25:12.903307 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:12.903283 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z"] Jun 03 19:25:12.907007 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:12.906982 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6add7c70_6d87_4784_b4c5_2a0771be28d0.slice/crio-7aaf7ad048cf35752177ee2609b578b19b73f8ee1618db03bc8cffee1747ca18 WatchSource:0}: Error finding container 7aaf7ad048cf35752177ee2609b578b19b73f8ee1618db03bc8cffee1747ca18: Status 404 returned error can't find the container with id 7aaf7ad048cf35752177ee2609b578b19b73f8ee1618db03bc8cffee1747ca18 Jun 03 19:25:13.616964 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:13.616915 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" event={"ID":"55ada238-a0b8-4e63-ac69-b978c0e8a48f","Type":"ContainerStarted","Data":"313565e539b8bd727ae3b31dff8ad5223cd431a34da3550779d98cb1fd9a71eb"} Jun 03 19:25:13.618611 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:13.618581 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" event={"ID":"6add7c70-6d87-4784-b4c5-2a0771be28d0","Type":"ContainerStarted","Data":"729c204c2c95706bfa286d8a9e587c0c9e2836f9464f3108254d667c9e99342f"} Jun 03 19:25:13.618793 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:13.618632 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" event={"ID":"6add7c70-6d87-4784-b4c5-2a0771be28d0","Type":"ContainerStarted","Data":"7aaf7ad048cf35752177ee2609b578b19b73f8ee1618db03bc8cffee1747ca18"} Jun 03 19:25:13.650257 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:13.650203 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wtw8z" podStartSLOduration=1.65018784 podStartE2EDuration="1.65018784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:13.648316479 +0000 UTC m=+263.388228585" watchObservedRunningTime="2026-06-03 19:25:13.65018784 +0000 UTC m=+263.390099964" Jun 03 19:25:15.625599 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:15.625563 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" event={"ID":"55ada238-a0b8-4e63-ac69-b978c0e8a48f","Type":"ContainerStarted","Data":"671503f938106a5ed2051c83421b9ba0b77816ea8e0799bc7126c1159f9ab995"} Jun 03 19:25:15.649123 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:15.649067 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" podStartSLOduration=1.198375848 podStartE2EDuration="3.64904749s" totalImagesPullingTime="2.450671642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:15.647890614 +0000 UTC m=+265.387802693" watchObservedRunningTime="2026-06-03 19:25:15.64904749 +0000 UTC m=+265.388959565" Jun 03 19:25:18.627574 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.627535 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd"] Jun 03 19:25:18.630747 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.630724 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" Jun 03 19:25:18.634348 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.634329 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j8228\"" Jun 03 19:25:18.634789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.634772 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 19:25:18.635951 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.635934 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 19:25:18.639729 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.639707 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd"] Jun 03 19:25:18.686573 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.686541 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngc4\" (UniqueName: \"kubernetes.io/projected/92bd9c8e-fd12-4a1a-8efa-fbd84b89890b-kube-api-access-tngc4\") pod \"migrator-955ffdf5f-99rgd\" (UID: \"92bd9c8e-fd12-4a1a-8efa-fbd84b89890b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" Jun 03 19:25:18.787781 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.787728 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngc4\" (UniqueName: \"kubernetes.io/projected/92bd9c8e-fd12-4a1a-8efa-fbd84b89890b-kube-api-access-tngc4\") pod \"migrator-955ffdf5f-99rgd\" (UID: \"92bd9c8e-fd12-4a1a-8efa-fbd84b89890b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" Jun 03 19:25:18.796054 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.796003 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngc4\" (UniqueName: \"kubernetes.io/projected/92bd9c8e-fd12-4a1a-8efa-fbd84b89890b-kube-api-access-tngc4\") pod \"migrator-955ffdf5f-99rgd\" (UID: \"92bd9c8e-fd12-4a1a-8efa-fbd84b89890b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" Jun 03 19:25:18.939588 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.939493 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" Jun 03 19:25:18.980761 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:18.980732 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57vsp_bd4f8689-587c-4232-b088-0d9a751ebc18/dns-node-resolver/0.log" Jun 03 19:25:19.012092 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.012062 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-pwxkv"] Jun 03 19:25:19.015571 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.015209 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.020044 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.020015 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 19:25:19.020483 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.020470 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 19:25:19.022589 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.022530 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 19:25:19.022589 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.022561 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 19:25:19.022589 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.022582 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-j4s6x\"" Jun 03 19:25:19.024933 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.024911 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-pwxkv"] Jun 03 19:25:19.064776 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.064698 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd"] Jun 03 19:25:19.067268 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:19.067243 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bd9c8e_fd12_4a1a_8efa_fbd84b89890b.slice/crio-c9562e6761b2b0dc90d28ab8f02dfefebc41954a0c3bf6499cca2ebaa4c018d0 WatchSource:0}: Error finding container c9562e6761b2b0dc90d28ab8f02dfefebc41954a0c3bf6499cca2ebaa4c018d0: Status 404 returned error can't find the container with id c9562e6761b2b0dc90d28ab8f02dfefebc41954a0c3bf6499cca2ebaa4c018d0 Jun 03 19:25:19.089877 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.089846 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f9ca0bf-918a-4d60-9473-83df49c33d2f-signing-key\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.090020 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.089883 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f9ca0bf-918a-4d60-9473-83df49c33d2f-signing-cabundle\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.090020 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.089912 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk6wl\" (UniqueName: \"kubernetes.io/projected/8f9ca0bf-918a-4d60-9473-83df49c33d2f-kube-api-access-lk6wl\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.190656 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.190574 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f9ca0bf-918a-4d60-9473-83df49c33d2f-signing-key\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.190656 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.190616 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f9ca0bf-918a-4d60-9473-83df49c33d2f-signing-cabundle\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.190656 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.190656 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6wl\" (UniqueName: \"kubernetes.io/projected/8f9ca0bf-918a-4d60-9473-83df49c33d2f-kube-api-access-lk6wl\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.191337 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.191319 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f9ca0bf-918a-4d60-9473-83df49c33d2f-signing-cabundle\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.192960 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.192941 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f9ca0bf-918a-4d60-9473-83df49c33d2f-signing-key\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.199637 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.199616 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk6wl\" (UniqueName: \"kubernetes.io/projected/8f9ca0bf-918a-4d60-9473-83df49c33d2f-kube-api-access-lk6wl\") pod \"service-ca-7d74d578b8-pwxkv\" (UID: \"8f9ca0bf-918a-4d60-9473-83df49c33d2f\") " pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.325631 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.325602 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" Jun 03 19:25:19.446940 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.446910 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-pwxkv"] Jun 03 19:25:19.448589 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:19.448560 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9ca0bf_918a_4d60_9473_83df49c33d2f.slice/crio-83d56c7a850116a169f0633256a97cdc2a6dce8b2272c458c5cf2dcf172653c1 WatchSource:0}: Error finding container 83d56c7a850116a169f0633256a97cdc2a6dce8b2272c458c5cf2dcf172653c1: Status 404 returned error can't find the container with id 83d56c7a850116a169f0633256a97cdc2a6dce8b2272c458c5cf2dcf172653c1 Jun 03 19:25:19.638693 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.638657 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" event={"ID":"92bd9c8e-fd12-4a1a-8efa-fbd84b89890b","Type":"ContainerStarted","Data":"c9562e6761b2b0dc90d28ab8f02dfefebc41954a0c3bf6499cca2ebaa4c018d0"} Jun 03 19:25:19.640058 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.640017 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" event={"ID":"8f9ca0bf-918a-4d60-9473-83df49c33d2f","Type":"ContainerStarted","Data":"560eddc67b1de480ec14f5a902e5b286b712c59b73816f653d8fa2be96e49e0a"} Jun 03 19:25:19.640185 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:19.640076 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" event={"ID":"8f9ca0bf-918a-4d60-9473-83df49c33d2f","Type":"ContainerStarted","Data":"83d56c7a850116a169f0633256a97cdc2a6dce8b2272c458c5cf2dcf172653c1"} Jun 03 19:25:20.204780 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:20.204756 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hs9n8_822c5330-5f6b-4384-9675-d7f1dd971a11/node-ca/0.log" Jun 03 19:25:20.644677 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:20.644644 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" event={"ID":"92bd9c8e-fd12-4a1a-8efa-fbd84b89890b","Type":"ContainerStarted","Data":"57cc5665a0642f0a5621c153c27fe09897131b35009fb1c20bffd57b3272174d"} Jun 03 19:25:20.645070 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:20.644731 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" event={"ID":"92bd9c8e-fd12-4a1a-8efa-fbd84b89890b","Type":"ContainerStarted","Data":"280742489f1b4ab61e0e871ebf1ab95957d892bc163f6247362ae21c65b8946b"} Jun 03 19:25:20.684695 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:20.684639 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-pwxkv" podStartSLOduration=2.684625116 podStartE2EDuration="2.684625116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:19.682618046 +0000 UTC m=+269.422530122" watchObservedRunningTime="2026-06-03 19:25:20.684625116 +0000 UTC m=+270.424537254" Jun 03 19:25:20.980512 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:20.980476 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj7fg_6eeeeef9-9080-408c-9c37-9ba54440b411/serve-healthcheck-canary/0.log" Jun 03 19:25:31.359502 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:31.359465 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6gxxk" podUID="14ba38e0-2bdf-465a-a42b-396462d66803" Jun 03 19:25:31.359502 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:31.359481 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" Jun 03 19:25:31.680707 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:31.680681 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:25:31.680896 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:31.680681 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gxxk" Jun 03 19:25:35.211451 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.211411 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:25:35.211834 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.211492 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:25:35.213730 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.213705 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14ba38e0-2bdf-465a-a42b-396462d66803-metrics-tls\") pod \"dns-default-6gxxk\" (UID: \"14ba38e0-2bdf-465a-a42b-396462d66803\") " pod="openshift-dns/dns-default-6gxxk" Jun 03 19:25:35.213839 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.213750 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"image-registry-5985f9dcfc-r4qct\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:25:35.285979 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.285946 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfxzd\"" Jun 03 19:25:35.285979 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.285946 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wcxmw\"" Jun 03 19:25:35.291788 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.291764 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:25:35.291926 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.291910 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gxxk" Jun 03 19:25:35.421596 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.421555 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-99rgd" podStartSLOduration=16.014968987 podStartE2EDuration="17.421535875s" totalImagesPullingTime="1.406566888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:20.684327029 +0000 UTC m=+270.424239110" watchObservedRunningTime="2026-06-03 19:25:35.421535875 +0000 UTC m=+285.161447954" Jun 03 19:25:35.422179 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.422162 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gxxk"] Jun 03 19:25:35.423852 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:35.423827 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ba38e0_2bdf_465a_a42b_396462d66803.slice/crio-3ec153f2dc36f849e9664181049faca4ccc780cc796b1fb48e64767a25f90d94 WatchSource:0}: Error finding container 3ec153f2dc36f849e9664181049faca4ccc780cc796b1fb48e64767a25f90d94: Status 404 returned error can't find the container with id 3ec153f2dc36f849e9664181049faca4ccc780cc796b1fb48e64767a25f90d94 Jun 03 19:25:35.439914 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.439850 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5985f9dcfc-r4qct"] Jun 03 19:25:35.443111 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:35.443081 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0da4ac_1b5d_467a_af7e_c49fb050839c.slice/crio-9ece7a5ff5e5e0fa74d9198733dc371aaf421acaeb13fe37103f2fd990b241ad WatchSource:0}: Error finding container 9ece7a5ff5e5e0fa74d9198733dc371aaf421acaeb13fe37103f2fd990b241ad: Status 404 returned error can't find the container with id 9ece7a5ff5e5e0fa74d9198733dc371aaf421acaeb13fe37103f2fd990b241ad Jun 03 19:25:35.694601 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.694570 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" event={"ID":"da0da4ac-1b5d-467a-af7e-c49fb050839c","Type":"ContainerStarted","Data":"c2eb44ce0e2073b931c0c34f0cd49f9d6df6d5c82325eac934e25e5a342d2487"} Jun 03 19:25:35.694791 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.694616 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" event={"ID":"da0da4ac-1b5d-467a-af7e-c49fb050839c","Type":"ContainerStarted","Data":"9ece7a5ff5e5e0fa74d9198733dc371aaf421acaeb13fe37103f2fd990b241ad"} Jun 03 19:25:35.694791 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.694667 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:25:35.695806 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.695783 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gxxk" event={"ID":"14ba38e0-2bdf-465a-a42b-396462d66803","Type":"ContainerStarted","Data":"3ec153f2dc36f849e9664181049faca4ccc780cc796b1fb48e64767a25f90d94"} Jun 03 19:25:35.723153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:35.723059 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" podStartSLOduration=284.72302649 podStartE2EDuration="4m44.72302649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:35.721759866 +0000 UTC m=+285.461671965" watchObservedRunningTime="2026-06-03 19:25:35.72302649 +0000 UTC m=+285.462938569" Jun 03 19:25:38.708407 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:38.708370 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gxxk" event={"ID":"14ba38e0-2bdf-465a-a42b-396462d66803","Type":"ContainerStarted","Data":"b2cbb98ef7e3a6118e53ebe8814a9eb2259a58939e722088340d61ef042ba6a4"} Jun 03 19:25:38.708887 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:38.708465 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gxxk" event={"ID":"14ba38e0-2bdf-465a-a42b-396462d66803","Type":"ContainerStarted","Data":"fd7ec170c190149ca3b6acc4378e7d152c5226f1ef546501bcdc092a5a2e336f"} Jun 03 19:25:38.708887 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:38.708513 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6gxxk" Jun 03 19:25:38.729095 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:38.729021 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6gxxk" podStartSLOduration=251.501360678 podStartE2EDuration="4m13.729007576s" totalImagesPullingTime="2.227646898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:38.728394623 +0000 UTC m=+288.468306716" watchObservedRunningTime="2026-06-03 19:25:38.729007576 +0000 UTC m=+288.468919655" Jun 03 19:25:40.716626 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:40.716594 2550 generic.go:356] "Generic (PLEG): container finished" podID="5ec6a577-6091-40f0-b84e-58416906d041" containerID="fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e" exitCode=1 Jun 03 19:25:40.717013 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:40.716652 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" event={"ID":"5ec6a577-6091-40f0-b84e-58416906d041","Type":"ContainerDied","Data":"fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e"} Jun 03 19:25:40.717013 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:40.716698 2550 scope.go:117] "RemoveContainer" containerID="85e117c961fbb648ac7b7c7dc8ea9d965f98f68640aee2b3ff3cf7ef8120da05" Jun 03 19:25:40.717013 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:40.716985 2550 scope.go:117] "RemoveContainer" containerID="fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e" Jun 03 19:25:40.717204 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:40.717185 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5bccd7ffb7-hmdtn_open-cluster-management-agent-addon(5ec6a577-6091-40f0-b84e-58416906d041)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" podUID="5ec6a577-6091-40f0-b84e-58416906d041" Jun 03 19:25:41.091411 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.091377 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jwvcm"] Jun 03 19:25:41.095751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.095732 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.099404 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.099371 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pgttb\"" Jun 03 19:25:41.099404 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.099371 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:25:41.099675 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.099660 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:25:41.100872 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.100856 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:25:41.100968 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.100895 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:25:41.132423 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.132395 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jwvcm"] Jun 03 19:25:41.157295 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.157257 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4529969-5740-4207-959d-74d931a4f48d-crio-socket\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.157454 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.157301 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4529969-5740-4207-959d-74d931a4f48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.157454 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.157341 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4529969-5740-4207-959d-74d931a4f48d-data-volume\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.157454 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.157364 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4529969-5740-4207-959d-74d931a4f48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.157584 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.157454 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7hps\" (UniqueName: \"kubernetes.io/projected/d4529969-5740-4207-959d-74d931a4f48d-kube-api-access-k7hps\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258113 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258077 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4529969-5740-4207-959d-74d931a4f48d-crio-socket\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258113 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258112 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4529969-5740-4207-959d-74d931a4f48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258352 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258141 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4529969-5740-4207-959d-74d931a4f48d-data-volume\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258352 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258227 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4529969-5740-4207-959d-74d931a4f48d-crio-socket\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258352 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258282 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4529969-5740-4207-959d-74d931a4f48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258479 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258457 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7hps\" (UniqueName: \"kubernetes.io/projected/d4529969-5740-4207-959d-74d931a4f48d-kube-api-access-k7hps\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258499 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4529969-5740-4207-959d-74d931a4f48d-data-volume\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.258807 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.258787 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4529969-5740-4207-959d-74d931a4f48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.260525 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.260504 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4529969-5740-4207-959d-74d931a4f48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.272596 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.272574 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7hps\" (UniqueName: \"kubernetes.io/projected/d4529969-5740-4207-959d-74d931a4f48d-kube-api-access-k7hps\") pod \"insights-runtime-extractor-jwvcm\" (UID: \"d4529969-5740-4207-959d-74d931a4f48d\") " pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.392046 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.392008 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:25:41.404324 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.404300 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jwvcm" Jun 03 19:25:41.529375 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.529352 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jwvcm"] Jun 03 19:25:41.531859 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:41.531832 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4529969_5740_4207_959d_74d931a4f48d.slice/crio-f87a14aacd5700e46bab0f1213a8d798676349451ec966b41a645aabf5b01c85 WatchSource:0}: Error finding container f87a14aacd5700e46bab0f1213a8d798676349451ec966b41a645aabf5b01c85: Status 404 returned error can't find the container with id f87a14aacd5700e46bab0f1213a8d798676349451ec966b41a645aabf5b01c85 Jun 03 19:25:41.721774 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.721690 2550 scope.go:117] "RemoveContainer" containerID="fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e" Jun 03 19:25:41.722170 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:41.721863 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5bccd7ffb7-hmdtn_open-cluster-management-agent-addon(5ec6a577-6091-40f0-b84e-58416906d041)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" podUID="5ec6a577-6091-40f0-b84e-58416906d041" Jun 03 19:25:41.722867 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.722848 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwvcm" event={"ID":"d4529969-5740-4207-959d-74d931a4f48d","Type":"ContainerStarted","Data":"0672240c44af9384ab35911c48b3e8f266dec3794b81690496b9fa2efecf5a89"} Jun 03 19:25:41.722921 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:41.722896 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwvcm" event={"ID":"d4529969-5740-4207-959d-74d931a4f48d","Type":"ContainerStarted","Data":"f87a14aacd5700e46bab0f1213a8d798676349451ec966b41a645aabf5b01c85"} Jun 03 19:25:42.731610 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:42.731527 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwvcm" event={"ID":"d4529969-5740-4207-959d-74d931a4f48d","Type":"ContainerStarted","Data":"882cf86a70b58e405fe6129dcc8b48d696a47b35075f0b577f9abd6ae36dae39"} Jun 03 19:25:43.726391 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:43.726338 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-25zwz" podUID="b6b625c0-e0f2-44b3-b858-7d26d8a2746f" Jun 03 19:25:44.613838 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:44.613806 2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:25:44.614217 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:44.614179 2550 scope.go:117] "RemoveContainer" containerID="fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e" Jun 03 19:25:44.614373 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:44.614341 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5bccd7ffb7-hmdtn_open-cluster-management-agent-addon(5ec6a577-6091-40f0-b84e-58416906d041)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" podUID="5ec6a577-6091-40f0-b84e-58416906d041" Jun 03 19:25:44.739783 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:44.739746 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwvcm" event={"ID":"d4529969-5740-4207-959d-74d931a4f48d","Type":"ContainerStarted","Data":"cd84a04622682e814c651696c18444fa7fafbb8d77260a86d0c3bae541a012f7"} Jun 03 19:25:44.760901 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:44.760853 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jwvcm" podStartSLOduration=1.360620188 podStartE2EDuration="3.760837242s" totalImagesPullingTime="2.400217054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:25:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:44.759789387 +0000 UTC m=+294.499701498" watchObservedRunningTime="2026-06-03 19:25:44.760837242 +0000 UTC m=+294.500749336" Jun 03 19:25:47.340027 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.339988 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p"] Jun 03 19:25:47.343404 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.343387 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:47.346409 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.346382 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 19:25:47.346525 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.346389 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nnmt8\"" Jun 03 19:25:47.353594 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.353571 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p"] Jun 03 19:25:47.405972 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.405942 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f5bfee7-5c04-4a0a-b4d1-55d304611bc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tll5p\" (UID: \"5f5bfee7-5c04-4a0a-b4d1-55d304611bc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:47.506870 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:47.506829 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f5bfee7-5c04-4a0a-b4d1-55d304611bc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tll5p\" (UID: \"5f5bfee7-5c04-4a0a-b4d1-55d304611bc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:47.507078 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:47.506979 2550 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 03 19:25:47.507078 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:47.507057 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f5bfee7-5c04-4a0a-b4d1-55d304611bc1-tls-certificates podName:5f5bfee7-5c04-4a0a-b4d1-55d304611bc1 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:48.007039796 +0000 UTC m=+297.746951869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5f5bfee7-5c04-4a0a-b4d1-55d304611bc1-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-tll5p" (UID: "5f5bfee7-5c04-4a0a-b4d1-55d304611bc1") : secret "prometheus-operator-admission-webhook-tls" not found Jun 03 19:25:48.009802 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:48.009745 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f5bfee7-5c04-4a0a-b4d1-55d304611bc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tll5p\" (UID: \"5f5bfee7-5c04-4a0a-b4d1-55d304611bc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:48.012154 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:48.012133 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f5bfee7-5c04-4a0a-b4d1-55d304611bc1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tll5p\" (UID: \"5f5bfee7-5c04-4a0a-b4d1-55d304611bc1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:48.252426 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:48.252387 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:48.378684 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:48.378652 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p"] Jun 03 19:25:48.381858 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:48.381832 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5bfee7_5c04_4a0a_b4d1_55d304611bc1.slice/crio-626897bb038b85c8fce4f3ea2f5c11100cb0827bd23513ca6432e38026667bab WatchSource:0}: Error finding container 626897bb038b85c8fce4f3ea2f5c11100cb0827bd23513ca6432e38026667bab: Status 404 returned error can't find the container with id 626897bb038b85c8fce4f3ea2f5c11100cb0827bd23513ca6432e38026667bab Jun 03 19:25:48.714872 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:48.714843 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6gxxk" Jun 03 19:25:48.754206 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:48.754164 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" event={"ID":"5f5bfee7-5c04-4a0a-b4d1-55d304611bc1","Type":"ContainerStarted","Data":"626897bb038b85c8fce4f3ea2f5c11100cb0827bd23513ca6432e38026667bab"} Jun 03 19:25:49.759615 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:49.759579 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" event={"ID":"5f5bfee7-5c04-4a0a-b4d1-55d304611bc1","Type":"ContainerStarted","Data":"78d2aec0c768173d97e68530c441eb3fc16fd73f5209dff9dba4cc171a9ddb3f"} Jun 03 19:25:49.759994 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:49.759760 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:49.763994 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:49.763967 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" Jun 03 19:25:49.776265 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:49.776217 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tll5p" podStartSLOduration=1.594137186 podStartE2EDuration="2.776201017s" totalImagesPullingTime="1.182063831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:49.775948071 +0000 UTC m=+299.515860176" watchObservedRunningTime="2026-06-03 19:25:49.776201017 +0000 UTC m=+299.516113097" Jun 03 19:25:50.681069 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:50.681013 2550 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:25:54.798070 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.798012 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk"] Jun 03 19:25:54.803315 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.803296 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:54.806701 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.806663 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-825tf\"" Jun 03 19:25:54.806832 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.806736 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 19:25:54.807118 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.806921 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:25:54.808409 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.808218 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 19:25:54.808409 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.808273 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:25:54.808409 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.808220 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:25:54.819900 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.819872 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk"] Jun 03 19:25:54.826141 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.826116 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg"] Jun 03 19:25:54.830714 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.830693 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.834449 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.834430 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 19:25:54.834663 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.834645 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 19:25:54.834977 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.834956 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xpj2t\"" Jun 03 19:25:54.835354 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.835336 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 19:25:54.841356 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.841335 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brbrx"] Jun 03 19:25:54.845313 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.845297 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.848711 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.848686 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg"] Jun 03 19:25:54.848911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.848783 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:25:54.849208 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.848897 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:25:54.849361 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.848956 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:25:54.862564 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.862542 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmdrk\"" Jun 03 19:25:54.963717 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963678 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.963717 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963714 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/629cca99-1fe9-486f-93e6-0700079efea4-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:54.963952 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963742 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.963952 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963761 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.963952 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963782 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-accelerators-collector-config\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.963952 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963873 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.963952 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963913 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q254v\" (UniqueName: \"kubernetes.io/projected/629cca99-1fe9-486f-93e6-0700079efea4-kube-api-access-q254v\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:54.963952 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963940 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhpt9\" (UniqueName: \"kubernetes.io/projected/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-kube-api-access-vhpt9\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.964220 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.963987 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:54.964220 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964049 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-tls\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.964220 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964090 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e009862-4506-4ad4-b330-c20f2dd53b59-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.964220 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964115 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:54.964220 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964142 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-root\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.964220 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964187 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-metrics-client-ca\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.964446 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964227 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-textfile\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.964446 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964259 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e009862-4506-4ad4-b330-c20f2dd53b59-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.964446 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964287 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp6jx\" (UniqueName: \"kubernetes.io/projected/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-api-access-lp6jx\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:54.964446 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964307 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-sys\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:54.964446 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:54.964329 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-wtmp\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.065459 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065348 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.065459 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065401 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/629cca99-1fe9-486f-93e6-0700079efea4-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.065459 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065431 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.065731 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065511 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.065731 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065562 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-accelerators-collector-config\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.065731 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065712 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.065878 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065748 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q254v\" (UniqueName: \"kubernetes.io/projected/629cca99-1fe9-486f-93e6-0700079efea4-kube-api-access-q254v\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.065878 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065779 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhpt9\" (UniqueName: \"kubernetes.io/projected/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-kube-api-access-vhpt9\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066025 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.065998 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.066122 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066069 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-tls\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066126 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e009862-4506-4ad4-b330-c20f2dd53b59-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.066232 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066184 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.066283 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066224 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-root\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066283 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066256 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-metrics-client-ca\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066383 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066282 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-textfile\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066383 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066311 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e009862-4506-4ad4-b330-c20f2dd53b59-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.066383 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066316 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/629cca99-1fe9-486f-93e6-0700079efea4-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.066383 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066332 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.066586 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066340 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp6jx\" (UniqueName: \"kubernetes.io/projected/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-api-access-lp6jx\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.066645 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066621 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-sys\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066701 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066656 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-textfile\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066701 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066664 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-wtmp\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066805 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066664 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e009862-4506-4ad4-b330-c20f2dd53b59-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.066805 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066757 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-sys\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066911 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:55.066829 2550 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 19:25:55.066911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.066836 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-wtmp\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.066911 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:25:55.066895 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-tls podName:629cca99-1fe9-486f-93e6-0700079efea4 nodeName:}" failed. No retries permitted until 2026-06-03 19:25:55.566876752 +0000 UTC m=+305.306788812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-qbbfk" (UID: "629cca99-1fe9-486f-93e6-0700079efea4") : secret "openshift-state-metrics-tls" not found Jun 03 19:25:55.067301 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.067273 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-accelerators-collector-config\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.067452 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.067365 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-metrics-client-ca\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.067567 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.067407 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-root\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.067789 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.067767 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e009862-4506-4ad4-b330-c20f2dd53b59-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.068468 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.068438 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.068619 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.068597 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-node-exporter-tls\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.068796 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.068781 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.068933 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.068911 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.069268 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.069251 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.077893 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.077867 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp6jx\" (UniqueName: \"kubernetes.io/projected/7e009862-4506-4ad4-b330-c20f2dd53b59-kube-api-access-lp6jx\") pod \"kube-state-metrics-79fb7d47d4-jfgsg\" (UID: \"7e009862-4506-4ad4-b330-c20f2dd53b59\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.078065 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.078023 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhpt9\" (UniqueName: \"kubernetes.io/projected/62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43-kube-api-access-vhpt9\") pod \"node-exporter-brbrx\" (UID: \"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43\") " pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.078155 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.078142 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q254v\" (UniqueName: \"kubernetes.io/projected/629cca99-1fe9-486f-93e6-0700079efea4-kube-api-access-q254v\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.141510 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.141472 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" Jun 03 19:25:55.157088 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.157058 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brbrx" Jun 03 19:25:55.168583 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:55.168554 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d9a27b_2c8a_46fc_a07f_d64f9ed5ec43.slice/crio-516aded932b8f7c7bff3149bdf8f84a4076f15ba9797a245f49a651fc82dd6ef WatchSource:0}: Error finding container 516aded932b8f7c7bff3149bdf8f84a4076f15ba9797a245f49a651fc82dd6ef: Status 404 returned error can't find the container with id 516aded932b8f7c7bff3149bdf8f84a4076f15ba9797a245f49a651fc82dd6ef Jun 03 19:25:55.170498 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.170480 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:25:55.283497 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.283460 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg"] Jun 03 19:25:55.286515 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:55.286485 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e009862_4506_4ad4_b330_c20f2dd53b59.slice/crio-53b531f9d23df1d7766e7dbded4cf1fbd45fddbd71e650bdb5d8b860a14d0ec1 WatchSource:0}: Error finding container 53b531f9d23df1d7766e7dbded4cf1fbd45fddbd71e650bdb5d8b860a14d0ec1: Status 404 returned error can't find the container with id 53b531f9d23df1d7766e7dbded4cf1fbd45fddbd71e650bdb5d8b860a14d0ec1 Jun 03 19:25:55.296437 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.296411 2550 patch_prober.go:28] interesting pod/image-registry-5985f9dcfc-r4qct container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 19:25:55.296532 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.296456 2550 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:25:55.570184 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.570147 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.572484 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.572452 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/629cca99-1fe9-486f-93e6-0700079efea4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qbbfk\" (UID: \"629cca99-1fe9-486f-93e6-0700079efea4\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.715349 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.715306 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" Jun 03 19:25:55.725409 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.724862 2550 scope.go:117] "RemoveContainer" containerID="fd189a25df88ee0fb299e434027f6bd03ea017fafc952216d2baaa0e0a14930e" Jun 03 19:25:55.780944 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.780882 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbrx" event={"ID":"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43","Type":"ContainerStarted","Data":"516aded932b8f7c7bff3149bdf8f84a4076f15ba9797a245f49a651fc82dd6ef"} Jun 03 19:25:55.783404 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.783342 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" event={"ID":"7e009862-4506-4ad4-b330-c20f2dd53b59","Type":"ContainerStarted","Data":"53b531f9d23df1d7766e7dbded4cf1fbd45fddbd71e650bdb5d8b860a14d0ec1"} Jun 03 19:25:55.892097 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:55.892021 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk"] Jun 03 19:25:56.116801 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:25:56.116762 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629cca99_1fe9_486f_93e6_0700079efea4.slice/crio-8e4fdb50a44bd01466c71d6ecb9e88fa3335977b4b3174491898737a53109e2a WatchSource:0}: Error finding container 8e4fdb50a44bd01466c71d6ecb9e88fa3335977b4b3174491898737a53109e2a: Status 404 returned error can't find the container with id 8e4fdb50a44bd01466c71d6ecb9e88fa3335977b4b3174491898737a53109e2a Jun 03 19:25:56.703495 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.703462 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:25:56.790327 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.790289 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" event={"ID":"5ec6a577-6091-40f0-b84e-58416906d041","Type":"ContainerStarted","Data":"b88e9ce124c9c339ae166ae95ca3f176b06b0dc03755555be3a7f659a337b0f4"} Jun 03 19:25:56.790750 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.790723 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:25:56.792443 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.792412 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bccd7ffb7-hmdtn" Jun 03 19:25:56.793339 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.793152 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" event={"ID":"629cca99-1fe9-486f-93e6-0700079efea4","Type":"ContainerStarted","Data":"bce99dd2dbdb38087dfd3fdb045df5f08cf198eb0c7bbbc7af200e0fd5d42529"} Jun 03 19:25:56.793339 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.793229 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" event={"ID":"629cca99-1fe9-486f-93e6-0700079efea4","Type":"ContainerStarted","Data":"95ed333dd937a9265378e2d041439d1f0d9efa2581c3b36a7830cb554c3c8649"} Jun 03 19:25:56.793339 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.793263 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" event={"ID":"629cca99-1fe9-486f-93e6-0700079efea4","Type":"ContainerStarted","Data":"8e4fdb50a44bd01466c71d6ecb9e88fa3335977b4b3174491898737a53109e2a"} Jun 03 19:25:56.796522 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.796491 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" event={"ID":"7e009862-4506-4ad4-b330-c20f2dd53b59","Type":"ContainerStarted","Data":"18e98aa6b6fbbf7e0267741c145fe4e3eb8af0bedffc0646d7c24f91fda55489"} Jun 03 19:25:56.799458 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.799370 2550 generic.go:356] "Generic (PLEG): container finished" podID="62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43" containerID="ba9a08fe1350da3346b08bb253196b5bb356e20084fa040d13cb6954e611dc66" exitCode=0 Jun 03 19:25:56.799458 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:56.799409 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbrx" event={"ID":"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43","Type":"ContainerDied","Data":"ba9a08fe1350da3346b08bb253196b5bb356e20084fa040d13cb6954e611dc66"} Jun 03 19:25:57.724399 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.724368 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:25:57.806246 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.806203 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbrx" event={"ID":"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43","Type":"ContainerStarted","Data":"532a9dfe87b6b01f915cbc9dd3988c8c6834e4c7825f54d103369c1acb75ecd8"} Jun 03 19:25:57.806427 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.806278 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbrx" event={"ID":"62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43","Type":"ContainerStarted","Data":"401471e7aecf54bb5d352c355b8f903c24c7e306fb8a5f03353f102a24f6c72a"} Jun 03 19:25:57.808893 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.808799 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" event={"ID":"629cca99-1fe9-486f-93e6-0700079efea4","Type":"ContainerStarted","Data":"ce073267209d7ee284872c0301f1e57f26ea0e70d0240269469fb0dc7e1e05bb"} Jun 03 19:25:57.811492 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.811453 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" event={"ID":"7e009862-4506-4ad4-b330-c20f2dd53b59","Type":"ContainerStarted","Data":"23f2cfbfa15b420c7bc0345d0a7b8372866170fc86222f8f8d694388b1e650a0"} Jun 03 19:25:57.811634 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.811537 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" event={"ID":"7e009862-4506-4ad4-b330-c20f2dd53b59","Type":"ContainerStarted","Data":"be7eff62a8aa17149c716a4498ab5e0410b0f2a04d4743d5f3e2b55fae3d4536"} Jun 03 19:25:57.829250 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.829181 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brbrx" podStartSLOduration=2.752091928 podStartE2EDuration="3.829161614s" totalImagesPullingTime="996.142978ms" totalInitContainerRuntime="80.926708ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:57.828189905 +0000 UTC m=+307.568102019" watchObservedRunningTime="2026-06-03 19:25:57.829161614 +0000 UTC m=+307.569073676" Jun 03 19:25:57.847551 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.847494 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qbbfk" podStartSLOduration=2.798253882 podStartE2EDuration="3.847475768s" totalImagesPullingTime="1.049221886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:57.846569891 +0000 UTC m=+307.586481997" watchObservedRunningTime="2026-06-03 19:25:57.847475768 +0000 UTC m=+307.587387850" Jun 03 19:25:57.871227 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:25:57.871163 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jfgsg" podStartSLOduration=2.493750659 podStartE2EDuration="3.871145015s" totalImagesPullingTime="1.377394356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:57.869857786 +0000 UTC m=+307.609769935" watchObservedRunningTime="2026-06-03 19:25:57.871145015 +0000 UTC m=+307.611057098" Jun 03 19:26:01.126742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.126702 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:26:01.130558 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.130539 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.135924 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.135897 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 19:26:01.135924 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.135897 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 19:26:01.136155 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.135900 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 19:26:01.137644 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.137604 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mfsjc\"" Jun 03 19:26:01.137767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.137616 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 19:26:01.137767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.137696 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 19:26:01.137767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.137634 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 19:26:01.137767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.137694 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 19:26:01.137767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.137702 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 19:26:01.138267 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.138247 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 19:26:01.138423 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.138275 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 19:26:01.138423 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.138278 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 19:26:01.138423 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.138252 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 19:26:01.138423 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.138252 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 19:26:01.138587 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.138460 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acg1kbp4sbhbb\"" Jun 03 19:26:01.139882 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.139867 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 19:26:01.142448 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.142430 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 19:26:01.157019 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.156991 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:26:01.226645 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226611 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226645 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226648 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226855 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226679 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226855 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226797 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226855 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226824 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-web-config\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226855 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226855 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226978 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226885 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226978 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226902 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226978 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226922 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226978 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226939 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.226978 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.226955 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227019 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496lv\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-kube-api-access-496lv\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227076 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-config-out\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227102 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227116 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227136 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227298 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227159 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227298 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227195 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227298 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227223 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-config\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.227298 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.227237 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328121 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328086 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496lv\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-kube-api-access-496lv\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328121 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328127 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-config-out\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328374 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328145 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328374 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328160 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328374 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328186 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328524 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328377 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328524 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328422 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328524 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328497 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-config\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328680 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328531 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328680 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328592 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328680 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328592 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328680 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328658 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328706 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328740 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328772 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-web-config\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328805 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328839 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.328880 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328864 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.329184 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328887 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.329184 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328915 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.329184 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328938 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.329184 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.328991 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.329770 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.329702 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.329960 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.329938 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.330503 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.330475 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.330972 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.330943 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.331087 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.331012 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.332299 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.332254 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.332731 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.332705 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.333425 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.333402 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334118 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.333751 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-config-out\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334118 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334000 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334118 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334051 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334118 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334057 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334453 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334200 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-config\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334453 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334440 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334566 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334484 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.334663 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.334643 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.335174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.335154 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-web-config\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.346348 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.346325 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-496lv\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-kube-api-access-496lv\") pod \"prometheus-k8s-0\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.440341 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.440254 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:01.603454 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.603420 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:26:01.606278 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:26:01.606251 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c9ad50_6bd1_49bd_a30f_48a930608476.slice/crio-3a0f49000e473519c7970072780af0b2fd08fed188b032b8e6c8c65b10496938 WatchSource:0}: Error finding container 3a0f49000e473519c7970072780af0b2fd08fed188b032b8e6c8c65b10496938: Status 404 returned error can't find the container with id 3a0f49000e473519c7970072780af0b2fd08fed188b032b8e6c8c65b10496938 Jun 03 19:26:01.830502 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:01.830412 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"3a0f49000e473519c7970072780af0b2fd08fed188b032b8e6c8c65b10496938"} Jun 03 19:26:02.835149 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:02.835061 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" exitCode=0 Jun 03 19:26:02.835149 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:02.835101 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} Jun 03 19:26:03.680313 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:03.680275 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5985f9dcfc-r4qct"] Jun 03 19:26:06.853825 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:06.853738 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} Jun 03 19:26:06.853825 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:06.853819 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} Jun 03 19:26:08.863849 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:08.863815 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} Jun 03 19:26:08.864344 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:08.863890 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} Jun 03 19:26:08.864344 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:08.863931 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} Jun 03 19:26:08.864344 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:08.863974 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerStarted","Data":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} Jun 03 19:26:11.440641 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:11.440610 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:26:28.706757 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.706692 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" containerName="registry" containerID="cri-o://c2eb44ce0e2073b931c0c34f0cd49f9d6df6d5c82325eac934e25e5a342d2487" gracePeriod=30 Jun 03 19:26:28.948416 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.948387 2550 generic.go:356] "Generic (PLEG): container finished" podID="da0da4ac-1b5d-467a-af7e-c49fb050839c" containerID="c2eb44ce0e2073b931c0c34f0cd49f9d6df6d5c82325eac934e25e5a342d2487" exitCode=0 Jun 03 19:26:28.948522 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.948459 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" event={"ID":"da0da4ac-1b5d-467a-af7e-c49fb050839c","Type":"ContainerDied","Data":"c2eb44ce0e2073b931c0c34f0cd49f9d6df6d5c82325eac934e25e5a342d2487"} Jun 03 19:26:28.948522 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.948506 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" event={"ID":"da0da4ac-1b5d-467a-af7e-c49fb050839c","Type":"ContainerDied","Data":"9ece7a5ff5e5e0fa74d9198733dc371aaf421acaeb13fe37103f2fd990b241ad"} Jun 03 19:26:28.948522 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.948521 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ece7a5ff5e5e0fa74d9198733dc371aaf421acaeb13fe37103f2fd990b241ad" Jun 03 19:26:28.958638 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.958580 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:26:28.985406 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:28.985348 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=21.633077113 podStartE2EDuration="27.985332631s" totalImagesPullingTime="6.334166501s" totalInitContainerRuntime="18.089017ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:26:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:08.92497566 +0000 UTC m=+318.664887740" watchObservedRunningTime="2026-06-03 19:26:28.985332631 +0000 UTC m=+338.725244757" Jun 03 19:26:29.080304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080258 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-certificates\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080304 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080312 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080335 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-bound-sa-token\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080369 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9w5z\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-kube-api-access-n9w5z\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080395 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-trusted-ca\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080431 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-installation-pull-secrets\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080476 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-image-registry-private-configuration\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080512 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da0da4ac-1b5d-467a-af7e-c49fb050839c-ca-trust-extracted\") pod \"da0da4ac-1b5d-467a-af7e-c49fb050839c\" (UID: \"da0da4ac-1b5d-467a-af7e-c49fb050839c\") " Jun 03 19:26:29.080841 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080786 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:26:29.081026 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.080993 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:26:29.082838 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.082799 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:26:29.083001 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.082968 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-kube-api-access-n9w5z" (OuterVolumeSpecName: "kube-api-access-n9w5z") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "kube-api-access-n9w5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:26:29.083131 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.083067 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:26:29.083193 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.083170 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:26:29.083317 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.083293 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:26:29.090417 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.090391 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da0da4ac-1b5d-467a-af7e-c49fb050839c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "da0da4ac-1b5d-467a-af7e-c49fb050839c" (UID: "da0da4ac-1b5d-467a-af7e-c49fb050839c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:26:29.182181 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182148 2550 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-tls\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182181 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182176 2550 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-bound-sa-token\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182181 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182189 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9w5z\" (UniqueName: \"kubernetes.io/projected/da0da4ac-1b5d-467a-af7e-c49fb050839c-kube-api-access-n9w5z\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182419 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182198 2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-trusted-ca\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182419 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182207 2550 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-installation-pull-secrets\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182419 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182217 2550 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da0da4ac-1b5d-467a-af7e-c49fb050839c-image-registry-private-configuration\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182419 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182235 2550 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da0da4ac-1b5d-467a-af7e-c49fb050839c-ca-trust-extracted\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.182419 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.182245 2550 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da0da4ac-1b5d-467a-af7e-c49fb050839c-registry-certificates\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:26:29.952248 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.952215 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f9dcfc-r4qct" Jun 03 19:26:29.976001 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.975969 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5985f9dcfc-r4qct"] Jun 03 19:26:29.980389 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:29.980364 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5985f9dcfc-r4qct"] Jun 03 19:26:30.727999 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:30.727964 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" path="/var/lib/kubelet/pods/da0da4ac-1b5d-467a-af7e-c49fb050839c/volumes" Jun 03 19:26:31.960433 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:31.960398 2550 generic.go:356] "Generic (PLEG): container finished" podID="55ada238-a0b8-4e63-ac69-b978c0e8a48f" containerID="671503f938106a5ed2051c83421b9ba0b77816ea8e0799bc7126c1159f9ab995" exitCode=0 Jun 03 19:26:31.960433 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:31.960440 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" event={"ID":"55ada238-a0b8-4e63-ac69-b978c0e8a48f","Type":"ContainerDied","Data":"671503f938106a5ed2051c83421b9ba0b77816ea8e0799bc7126c1159f9ab995"} Jun 03 19:26:31.960867 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:31.960825 2550 scope.go:117] "RemoveContainer" containerID="671503f938106a5ed2051c83421b9ba0b77816ea8e0799bc7126c1159f9ab995" Jun 03 19:26:32.967007 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:26:32.966970 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-wplq5" event={"ID":"55ada238-a0b8-4e63-ac69-b978c0e8a48f","Type":"ContainerStarted","Data":"c209f63bea0de19db6ec853c0dfbd717c7a1805471398c20f79c4ec12d9d7e39"} Jun 03 19:27:01.440820 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:01.440789 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:01.460605 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:01.460578 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:02.087066 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:02.087021 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:03.756332 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:03.756290 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:27:03.758555 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:03.758530 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b625c0-e0f2-44b3-b858-7d26d8a2746f-metrics-certs\") pod \"network-metrics-daemon-25zwz\" (UID: \"b6b625c0-e0f2-44b3-b858-7d26d8a2746f\") " pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:27:04.028619 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:04.028524 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-grwp9\"" Jun 03 19:27:04.036379 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:04.036354 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zwz" Jun 03 19:27:04.162840 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:04.162815 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25zwz"] Jun 03 19:27:04.165156 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:27:04.165124 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b625c0_e0f2_44b3_b858_7d26d8a2746f.slice/crio-564337c5a76ce956aa28965b07ca7aac8e5b6939e71ec2d89f7caaa015075a04 WatchSource:0}: Error finding container 564337c5a76ce956aa28965b07ca7aac8e5b6939e71ec2d89f7caaa015075a04: Status 404 returned error can't find the container with id 564337c5a76ce956aa28965b07ca7aac8e5b6939e71ec2d89f7caaa015075a04 Jun 03 19:27:05.085614 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:05.085573 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zwz" event={"ID":"b6b625c0-e0f2-44b3-b858-7d26d8a2746f","Type":"ContainerStarted","Data":"564337c5a76ce956aa28965b07ca7aac8e5b6939e71ec2d89f7caaa015075a04"} Jun 03 19:27:06.091084 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:06.091023 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zwz" event={"ID":"b6b625c0-e0f2-44b3-b858-7d26d8a2746f","Type":"ContainerStarted","Data":"ac7e557d52d255fb54898e601587c95a87dd78c3bc4c29ef4bc8044a599e7a8f"} Jun 03 19:27:06.091485 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:06.091108 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zwz" event={"ID":"b6b625c0-e0f2-44b3-b858-7d26d8a2746f","Type":"ContainerStarted","Data":"e21f55461d42698fec4dd8ab6d42c3949b3b6eb42c5e26ca257a8c5f2625d56f"} Jun 03 19:27:06.110224 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:06.110168 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-25zwz" podStartSLOduration=375.129488461 podStartE2EDuration="6m16.11015317s" totalImagesPullingTime="980.664709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:06.108408384 +0000 UTC m=+375.848320473" watchObservedRunningTime="2026-06-03 19:27:06.11015317 +0000 UTC m=+375.850065251" Jun 03 19:27:19.519214 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519174 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:27:19.519642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519460 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="prometheus" containerID="cri-o://23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" gracePeriod=600 Jun 03 19:27:19.519642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519482 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="thanos-sidecar" containerID="cri-o://c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" gracePeriod=600 Jun 03 19:27:19.519642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519521 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" gracePeriod=600 Jun 03 19:27:19.519642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519536 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-web" containerID="cri-o://51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" gracePeriod=600 Jun 03 19:27:19.519642 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519494 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy" containerID="cri-o://78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" gracePeriod=600 Jun 03 19:27:19.519890 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.519545 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="config-reloader" containerID="cri-o://8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" gracePeriod=600 Jun 03 19:27:19.747728 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.747702 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:19.887731 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887700 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-kube-rbac-proxy\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.887922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887747 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-thanos-prometheus-http-client-file\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.887922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887779 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-0\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.887922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887816 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.887922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887841 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-kubelet-serving-ca-bundle\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.887922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887877 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-metrics-client-certs\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.887922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887900 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-tls-assets\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887937 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-web-config\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887965 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-db\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.887988 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-config\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888014 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-metrics-client-ca\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888088 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-trusted-ca-bundle\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888113 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-tls\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888161 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-2\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888188 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-grpc-tls\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888232 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-496lv\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-kube-api-access-496lv\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888265 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-serving-certs-ca-bundle\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888264 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.888758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888304 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-config-out\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888331 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888369 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-1\") pod \"80c9ad50-6bd1-49bd-a30f-48a930608476\" (UID: \"80c9ad50-6bd1-49bd-a30f-48a930608476\") " Jun 03 19:27:19.888758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888563 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.888758 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888586 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.889059 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.888867 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.889059 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.889008 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.889661 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.889194 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.889661 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.889400 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.889661 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.889597 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:19.891351 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.890645 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.891351 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.890717 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.891859 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.891753 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.891859 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.891824 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:27:19.892110 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892048 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.892110 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892065 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.892340 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892310 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-config" (OuterVolumeSpecName: "config") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.892588 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892563 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:27:19.892947 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892920 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.892947 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892932 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.892947 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.892926 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-kube-api-access-496lv" (OuterVolumeSpecName: "kube-api-access-496lv") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "kube-api-access-496lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:27:19.893467 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.893449 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-config-out" (OuterVolumeSpecName: "config-out") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:27:19.901980 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.901960 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-web-config" (OuterVolumeSpecName: "web-config") pod "80c9ad50-6bd1-49bd-a30f-48a930608476" (UID: "80c9ad50-6bd1-49bd-a30f-48a930608476"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:19.989403 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989364 2550 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-metrics-client-certs\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989403 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989395 2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-tls-assets\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989403 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989405 2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-web-config\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989403 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989415 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-db\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989423 2550 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-config\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989434 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-metrics-client-ca\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989443 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989451 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989459 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989467 2550 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-grpc-tls\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989475 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-496lv\" (UniqueName: \"kubernetes.io/projected/80c9ad50-6bd1-49bd-a30f-48a930608476-kube-api-access-496lv\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989483 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989491 2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c9ad50-6bd1-49bd-a30f-48a930608476-config-out\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989499 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989509 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989517 2550 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-kube-rbac-proxy\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989525 2550 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989533 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80c9ad50-6bd1-49bd-a30f-48a930608476-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:19.989650 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:19.989541 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c9ad50-6bd1-49bd-a30f-48a930608476-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:27:20.153100 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153008 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" exitCode=0 Jun 03 19:27:20.153100 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153053 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" exitCode=0 Jun 03 19:27:20.153100 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153066 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" exitCode=0 Jun 03 19:27:20.153100 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153074 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" exitCode=0 Jun 03 19:27:20.153100 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153070 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153103 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153082 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" exitCode=0 Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153160 2550 generic.go:356] "Generic (PLEG): container finished" podID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" exitCode=0 Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153164 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153205 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153233 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153226 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153264 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153289 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} Jun 03 19:27:20.153377 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.153317 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80c9ad50-6bd1-49bd-a30f-48a930608476","Type":"ContainerDied","Data":"3a0f49000e473519c7970072780af0b2fd08fed188b032b8e6c8c65b10496938"} Jun 03 19:27:20.161094 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.160966 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.168098 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.168082 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.174755 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.174736 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.180767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.180749 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.185394 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.185370 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:27:20.188614 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.188589 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.190154 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.190137 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:27:20.195708 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.195685 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.202217 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.202192 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.202495 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.202476 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.202542 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.202502 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} err="failed to get container status \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" Jun 03 19:27:20.202542 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.202533 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.202743 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.202724 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.202809 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.202753 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} err="failed to get container status \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" Jun 03 19:27:20.202809 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.202777 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.203046 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.203014 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.203093 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203052 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} err="failed to get container status \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" Jun 03 19:27:20.203093 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203068 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.203277 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.203260 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.203354 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203283 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} err="failed to get container status \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" Jun 03 19:27:20.203354 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203299 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.203510 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.203493 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.203564 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203527 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} err="failed to get container status \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" Jun 03 19:27:20.203564 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203547 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.203780 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.203763 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.203818 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203785 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} err="failed to get container status \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" Jun 03 19:27:20.203818 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.203797 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.204021 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:27:20.204006 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.204095 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204025 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} err="failed to get container status \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" Jun 03 19:27:20.204095 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204081 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.204295 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204277 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} err="failed to get container status \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" Jun 03 19:27:20.204295 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204294 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.204469 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204453 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} err="failed to get container status \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" Jun 03 19:27:20.204518 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204469 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.204681 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204661 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} err="failed to get container status \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" Jun 03 19:27:20.204723 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204682 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.204871 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204849 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} err="failed to get container status \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" Jun 03 19:27:20.204913 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.204873 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.205092 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205077 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} err="failed to get container status \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" Jun 03 19:27:20.205141 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205092 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.205317 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205296 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} err="failed to get container status \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" Jun 03 19:27:20.205317 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205315 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.205525 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205508 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} err="failed to get container status \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" Jun 03 19:27:20.205525 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205523 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.205722 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205707 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} err="failed to get container status \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" Jun 03 19:27:20.205722 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205721 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.205909 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205894 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} err="failed to get container status \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" Jun 03 19:27:20.205909 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.205907 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.206105 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206087 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} err="failed to get container status \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" Jun 03 19:27:20.206153 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206105 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.206303 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206288 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} err="failed to get container status \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" Jun 03 19:27:20.206303 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206302 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.206511 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206490 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} err="failed to get container status \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" Jun 03 19:27:20.206552 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206513 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.206722 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206704 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} err="failed to get container status \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" Jun 03 19:27:20.206722 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206721 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.206904 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206886 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} err="failed to get container status \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" Jun 03 19:27:20.206946 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.206904 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.207101 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207082 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} err="failed to get container status \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" Jun 03 19:27:20.207149 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207101 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.207307 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207289 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} err="failed to get container status \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" Jun 03 19:27:20.207352 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207307 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.207486 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207471 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} err="failed to get container status \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" Jun 03 19:27:20.207528 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207486 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.207657 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207643 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} err="failed to get container status \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" Jun 03 19:27:20.207697 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207657 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.207842 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207827 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} err="failed to get container status \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" Jun 03 19:27:20.207888 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.207841 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.208062 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208022 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} err="failed to get container status \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" Jun 03 19:27:20.208131 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208064 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.208279 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208251 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} err="failed to get container status \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" Jun 03 19:27:20.208279 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208270 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.208481 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208466 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} err="failed to get container status \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" Jun 03 19:27:20.208481 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208480 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.208673 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208659 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} err="failed to get container status \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" Jun 03 19:27:20.208712 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208673 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.208854 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208839 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} err="failed to get container status \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" Jun 03 19:27:20.208902 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.208853 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.209071 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209056 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} err="failed to get container status \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" Jun 03 19:27:20.209109 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209071 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.209264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209249 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} err="failed to get container status \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" Jun 03 19:27:20.209264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209263 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.209444 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209429 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} err="failed to get container status \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" Jun 03 19:27:20.209481 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209443 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.209628 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209613 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} err="failed to get container status \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" Jun 03 19:27:20.209717 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209627 2550 scope.go:117] "RemoveContainer" containerID="4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2" Jun 03 19:27:20.209824 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209809 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2"} err="failed to get container status \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": rpc error: code = NotFound desc = could not find container \"4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2\": container with ID starting with 4b9b3f71331edb8bf37524e8865d172680ad7c9383215a6248bef329e8b2eaa2 not found: ID does not exist" Jun 03 19:27:20.209824 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209823 2550 scope.go:117] "RemoveContainer" containerID="78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e" Jun 03 19:27:20.210007 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.209992 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e"} err="failed to get container status \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": rpc error: code = NotFound desc = could not find container \"78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e\": container with ID starting with 78a49cd3e325a6419da49c59cd2275db9bb3295257ba29516cb2b80ff2e6507e not found: ID does not exist" Jun 03 19:27:20.210072 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210006 2550 scope.go:117] "RemoveContainer" containerID="51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96" Jun 03 19:27:20.210214 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210191 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96"} err="failed to get container status \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": rpc error: code = NotFound desc = could not find container \"51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96\": container with ID starting with 51d3ff0a5bcb23c6fc5ffd8567e38693fc88bc58f077eb71f29fc00ecdb69a96 not found: ID does not exist" Jun 03 19:27:20.210214 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210212 2550 scope.go:117] "RemoveContainer" containerID="c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac" Jun 03 19:27:20.210404 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210386 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac"} err="failed to get container status \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": rpc error: code = NotFound desc = could not find container \"c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac\": container with ID starting with c084bf9face13deae9827afe25bcdecd1ab3764568fd8e71afad420917967dac not found: ID does not exist" Jun 03 19:27:20.210444 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210405 2550 scope.go:117] "RemoveContainer" containerID="8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de" Jun 03 19:27:20.210596 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210579 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de"} err="failed to get container status \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": rpc error: code = NotFound desc = could not find container \"8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de\": container with ID starting with 8f3fa65952241f28521f4fe815408f035894b1fc0872efe52508858e7642b0de not found: ID does not exist" Jun 03 19:27:20.210634 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210597 2550 scope.go:117] "RemoveContainer" containerID="23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f" Jun 03 19:27:20.210780 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210765 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f"} err="failed to get container status \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": rpc error: code = NotFound desc = could not find container \"23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f\": container with ID starting with 23d77169cc0cc96b674dc060722e93c655f88de4ba77e71adc177b11ce2c002f not found: ID does not exist" Jun 03 19:27:20.210837 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210779 2550 scope.go:117] "RemoveContainer" containerID="f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76" Jun 03 19:27:20.210997 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.210970 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76"} err="failed to get container status \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": rpc error: code = NotFound desc = could not find container \"f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76\": container with ID starting with f890c0119347e4be74f9e3d65bcc6802f771271fb2318cd7c10454b8ac681f76 not found: ID does not exist" Jun 03 19:27:20.223128 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223102 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:27:20.223390 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223377 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" containerName="registry" Jun 03 19:27:20.223430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223392 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" containerName="registry" Jun 03 19:27:20.223430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223399 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy" Jun 03 19:27:20.223430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223406 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy" Jun 03 19:27:20.223430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223412 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="config-reloader" Jun 03 19:27:20.223430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223418 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="config-reloader" Jun 03 19:27:20.223430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223429 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="prometheus" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223434 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="prometheus" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223440 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-web" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223446 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-web" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223451 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="init-config-reloader" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223457 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="init-config-reloader" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223462 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-thanos" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223467 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-thanos" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223475 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="thanos-sidecar" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223480 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="thanos-sidecar" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223521 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="prometheus" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223530 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="da0da4ac-1b5d-467a-af7e-c49fb050839c" containerName="registry" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223536 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223542 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="config-reloader" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223547 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-web" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223553 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="thanos-sidecar" Jun 03 19:27:20.223598 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.223559 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" containerName="kube-rbac-proxy-thanos" Jun 03 19:27:20.228707 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.228691 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.233141 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.233123 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 19:27:20.233358 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.233344 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 19:27:20.234185 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.234167 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 19:27:20.234305 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.234170 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 19:27:20.234464 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.234446 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mfsjc\"" Jun 03 19:27:20.234464 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.234459 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 19:27:20.235178 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.234998 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 19:27:20.235178 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.235003 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 19:27:20.235537 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.235517 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acg1kbp4sbhbb\"" Jun 03 19:27:20.235706 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.235691 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 19:27:20.235834 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.235821 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 19:27:20.237951 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.237931 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 19:27:20.238680 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.238665 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 19:27:20.239276 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.239261 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 19:27:20.240282 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.240264 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 19:27:20.243958 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.243941 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 19:27:20.244468 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.244452 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 19:27:20.249307 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.249285 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:27:20.292559 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292524 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292559 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292565 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292764 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292588 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292764 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292616 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292764 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292636 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8sl2\" (UniqueName: \"kubernetes.io/projected/cbf4c919-3b06-40b4-ae9d-49414ae19d60-kube-api-access-t8sl2\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292764 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292653 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbf4c919-3b06-40b4-ae9d-49414ae19d60-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292764 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292733 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292766 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292786 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292811 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292827 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-config\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292845 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292870 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292893 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.292911 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292910 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbf4c919-3b06-40b4-ae9d-49414ae19d60-config-out\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.293162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292925 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.293162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292940 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.293162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292963 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.293162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.292986 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.293162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.293002 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-web-config\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.393815 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.393761 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.393815 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.393815 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394079 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.393927 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394079 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.393960 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8sl2\" (UniqueName: \"kubernetes.io/projected/cbf4c919-3b06-40b4-ae9d-49414ae19d60-kube-api-access-t8sl2\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394079 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.393980 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbf4c919-3b06-40b4-ae9d-49414ae19d60-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394253 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394106 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394253 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394167 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394253 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394200 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394253 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394241 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394266 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-config\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394297 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394331 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394357 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394385 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbf4c919-3b06-40b4-ae9d-49414ae19d60-config-out\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394408 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394445 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394432 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394455 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394479 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394484 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394553 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-web-config\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394607 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.394767 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.394646 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.395197 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.395012 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.395260 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.395190 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.396087 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.395836 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.396087 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.395845 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.396087 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.395970 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.397301 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.397177 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-config\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.397842 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.397780 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cbf4c919-3b06-40b4-ae9d-49414ae19d60-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.397842 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.397793 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.398140 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.398087 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbf4c919-3b06-40b4-ae9d-49414ae19d60-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.398384 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.398362 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-web-config\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.398701 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.398675 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.399146 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.399125 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.399146 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.399142 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.399308 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.399206 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbf4c919-3b06-40b4-ae9d-49414ae19d60-config-out\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.399464 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.399439 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.399982 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.399965 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.400133 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.400117 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cbf4c919-3b06-40b4-ae9d-49414ae19d60-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.403206 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.403165 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8sl2\" (UniqueName: \"kubernetes.io/projected/cbf4c919-3b06-40b4-ae9d-49414ae19d60-kube-api-access-t8sl2\") pod \"prometheus-k8s-0\" (UID: \"cbf4c919-3b06-40b4-ae9d-49414ae19d60\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.538599 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.538560 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:27:20.676438 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.676298 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 19:27:20.678622 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:27:20.678587 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf4c919_3b06_40b4_ae9d_49414ae19d60.slice/crio-dfe58708e0085bdee5afbcdabf6fdc800aca2ae3589219870e04a48d6cae42e2 WatchSource:0}: Error finding container dfe58708e0085bdee5afbcdabf6fdc800aca2ae3589219870e04a48d6cae42e2: Status 404 returned error can't find the container with id dfe58708e0085bdee5afbcdabf6fdc800aca2ae3589219870e04a48d6cae42e2 Jun 03 19:27:20.729451 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:20.729424 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c9ad50-6bd1-49bd-a30f-48a930608476" path="/var/lib/kubelet/pods/80c9ad50-6bd1-49bd-a30f-48a930608476/volumes" Jun 03 19:27:21.159433 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:21.159399 2550 generic.go:356] "Generic (PLEG): container finished" podID="cbf4c919-3b06-40b4-ae9d-49414ae19d60" containerID="8a2081152b0a390b14b9221fca52014cb42d62743b19b334d1ab3e2e9f4ee779" exitCode=0 Jun 03 19:27:21.159604 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:21.159472 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerDied","Data":"8a2081152b0a390b14b9221fca52014cb42d62743b19b334d1ab3e2e9f4ee779"} Jun 03 19:27:21.159604 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:21.159539 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"dfe58708e0085bdee5afbcdabf6fdc800aca2ae3589219870e04a48d6cae42e2"} Jun 03 19:27:22.166393 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.166358 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"bd717758e4937acd4f48c96acfc73d8e4b1b2c83834b42f24e97bbc41d974caf"} Jun 03 19:27:22.166850 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.166449 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"c4a54189bcc7aa25006f565595e0a2bfae4345e4a19aa18dd73502c47a954b04"} Jun 03 19:27:22.166850 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.166476 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"45bdb61bca13b909507a289ae17924f2107a5fad9fcdbdfd50f7bd89b8e6fe80"} Jun 03 19:27:22.166850 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.166500 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"4a1ea272373be0d207497e2751251e04a82c2f288cc92e62bfc4c9a1faf21707"} Jun 03 19:27:22.166850 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.166529 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"eac347da94650983edff1f0aeeb25a9cd829f1f37d8427c5da29263a32ff31af"} Jun 03 19:27:22.166850 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.166553 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cbf4c919-3b06-40b4-ae9d-49414ae19d60","Type":"ContainerStarted","Data":"480a4ed34b5abddf57307c53e466f621756461cde8b0324a29b275fc45cee029"} Jun 03 19:27:22.197554 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:22.197502 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.177765875 podStartE2EDuration="2.197481493s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.715618ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:22.194923872 +0000 UTC m=+391.934835949" watchObservedRunningTime="2026-06-03 19:27:22.197481493 +0000 UTC m=+391.937393574" Jun 03 19:27:25.539149 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:27:25.539112 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:28:20.538840 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:28:20.538748 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:28:20.554415 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:28:20.554386 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:28:21.403742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:28:21.403714 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 19:29:58.221413 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.221327 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk"] Jun 03 19:29:58.224502 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.224482 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.228091 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.228059 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:29:58.229625 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.229612 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 19:29:58.229734 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.229652 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h7qx6\"" Jun 03 19:29:58.235530 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.235507 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk"] Jun 03 19:29:58.348876 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.348841 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26d4\" (UniqueName: \"kubernetes.io/projected/f8daa258-94a4-4c95-b484-3135eae26ac0-kube-api-access-k26d4\") pod \"openshift-lws-operator-fd8ccff4c-7k4xk\" (UID: \"f8daa258-94a4-4c95-b484-3135eae26ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.349098 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.348897 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8daa258-94a4-4c95-b484-3135eae26ac0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7k4xk\" (UID: \"f8daa258-94a4-4c95-b484-3135eae26ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.450372 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.450339 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26d4\" (UniqueName: \"kubernetes.io/projected/f8daa258-94a4-4c95-b484-3135eae26ac0-kube-api-access-k26d4\") pod \"openshift-lws-operator-fd8ccff4c-7k4xk\" (UID: \"f8daa258-94a4-4c95-b484-3135eae26ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.450515 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.450387 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8daa258-94a4-4c95-b484-3135eae26ac0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7k4xk\" (UID: \"f8daa258-94a4-4c95-b484-3135eae26ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.450763 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.450747 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8daa258-94a4-4c95-b484-3135eae26ac0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7k4xk\" (UID: \"f8daa258-94a4-4c95-b484-3135eae26ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.461239 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.461208 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26d4\" (UniqueName: \"kubernetes.io/projected/f8daa258-94a4-4c95-b484-3135eae26ac0-kube-api-access-k26d4\") pod \"openshift-lws-operator-fd8ccff4c-7k4xk\" (UID: \"f8daa258-94a4-4c95-b484-3135eae26ac0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.547897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.547795 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" Jun 03 19:29:58.680275 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.680168 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk"] Jun 03 19:29:58.682433 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:29:58.682405 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8daa258_94a4_4c95_b484_3135eae26ac0.slice/crio-f554fa2dd0ed0fea1a4707ab7bf60f33cf2009b6a4ad1584844f08cfebd73094 WatchSource:0}: Error finding container f554fa2dd0ed0fea1a4707ab7bf60f33cf2009b6a4ad1584844f08cfebd73094: Status 404 returned error can't find the container with id f554fa2dd0ed0fea1a4707ab7bf60f33cf2009b6a4ad1584844f08cfebd73094 Jun 03 19:29:58.750145 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:29:58.750112 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" event={"ID":"f8daa258-94a4-4c95-b484-3135eae26ac0","Type":"ContainerStarted","Data":"f554fa2dd0ed0fea1a4707ab7bf60f33cf2009b6a4ad1584844f08cfebd73094"} Jun 03 19:30:01.765043 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:01.764943 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" event={"ID":"f8daa258-94a4-4c95-b484-3135eae26ac0","Type":"ContainerStarted","Data":"1f22f74046bdb07f1094262a0da187e9fb5fa8ef84991133a827fe00959a5f07"} Jun 03 19:30:01.784233 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:01.784168 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7k4xk" podStartSLOduration=1.105313394 podStartE2EDuration="3.784147034s" totalImagesPullingTime="2.67883364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:01.783694375 +0000 UTC m=+551.523606457" watchObservedRunningTime="2026-06-03 19:30:01.784147034 +0000 UTC m=+551.524059120" Jun 03 19:30:17.970088 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.970048 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv"] Jun 03 19:30:17.974683 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.974655 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:17.979145 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.979123 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srlj4\"" Jun 03 19:30:17.980162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.980145 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:30:17.980623 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.980607 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:30:17.981264 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.981242 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:30:17.981777 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:17.981755 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:30:18.013551 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.013515 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.013742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.013593 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.013742 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.013658 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.013861 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.013742 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.013861 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.013767 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjft7\" (UniqueName: \"kubernetes.io/projected/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-kube-api-access-vjft7\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.114653 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.114606 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.114653 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.114651 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.114909 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.114793 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.114909 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.114878 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.114909 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.114905 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjft7\" (UniqueName: \"kubernetes.io/projected/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-kube-api-access-vjft7\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.115398 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.115348 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.117597 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.117572 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.117769 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.117748 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv"] Jun 03 19:30:18.117833 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.117788 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.118164 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.118144 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.130787 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.130758 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjft7\" (UniqueName: \"kubernetes.io/projected/27e7b76e-1b6c-4107-8f4a-0beae1b44d23-kube-api-access-vjft7\") pod \"opendatahub-operator-controller-manager-7d56d45df5-ck7fv\" (UID: \"27e7b76e-1b6c-4107-8f4a-0beae1b44d23\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.285370 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.285267 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:18.430579 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.430540 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv"] Jun 03 19:30:18.433287 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:30:18.433259 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e7b76e_1b6c_4107_8f4a_0beae1b44d23.slice/crio-b62041e7783771a4ff5ee609f4d6a526a435b147c08a6db55ed2460d7ee04506 WatchSource:0}: Error finding container b62041e7783771a4ff5ee609f4d6a526a435b147c08a6db55ed2460d7ee04506: Status 404 returned error can't find the container with id b62041e7783771a4ff5ee609f4d6a526a435b147c08a6db55ed2460d7ee04506 Jun 03 19:30:18.835623 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:18.835588 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" event={"ID":"27e7b76e-1b6c-4107-8f4a-0beae1b44d23","Type":"ContainerStarted","Data":"b62041e7783771a4ff5ee609f4d6a526a435b147c08a6db55ed2460d7ee04506"} Jun 03 19:30:21.855316 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:21.855219 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" event={"ID":"27e7b76e-1b6c-4107-8f4a-0beae1b44d23","Type":"ContainerStarted","Data":"93a528c0c2fcc79fe015ac03b67dfd5754e3cb73c14742ecb6b94a8b66fa816a"} Jun 03 19:30:22.861177 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:22.861098 2550 generic.go:356] "Generic (PLEG): container finished" podID="27e7b76e-1b6c-4107-8f4a-0beae1b44d23" containerID="93a528c0c2fcc79fe015ac03b67dfd5754e3cb73c14742ecb6b94a8b66fa816a" exitCode=0 Jun 03 19:30:22.861532 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:22.861185 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" event={"ID":"27e7b76e-1b6c-4107-8f4a-0beae1b44d23","Type":"ContainerDied","Data":"93a528c0c2fcc79fe015ac03b67dfd5754e3cb73c14742ecb6b94a8b66fa816a"} Jun 03 19:30:23.867412 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:23.867365 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" event={"ID":"27e7b76e-1b6c-4107-8f4a-0beae1b44d23","Type":"ContainerStarted","Data":"80cbeaf0eac230d829b0ab7feb62f04c15dcbd973a9bcb1df9ffc645b0fca79d"} Jun 03 19:30:23.867866 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:23.867516 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:23.893733 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:23.893679 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" podStartSLOduration=2.500418548 podStartE2EDuration="6.893661985s" totalImagesPullingTime="3.314797522s" totalInitContainerRuntime="1.078445915s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:23.891556277 +0000 UTC m=+573.631468383" watchObservedRunningTime="2026-06-03 19:30:23.893661985 +0000 UTC m=+573.633574065" Jun 03 19:30:34.874165 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:34.874134 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-ck7fv" Jun 03 19:30:35.848150 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.848113 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg"] Jun 03 19:30:35.873319 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.873288 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg"] Jun 03 19:30:35.873475 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.873400 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:35.879154 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.879127 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 19:30:35.879568 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.879289 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 19:30:35.879568 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.879159 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 19:30:35.879568 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.879159 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nhdrj\"" Jun 03 19:30:35.962226 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.962177 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-manager-config\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:35.962226 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.962226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f6rc\" (UniqueName: \"kubernetes.io/projected/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-kube-api-access-8f6rc\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:35.962436 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.962311 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-metrics-cert\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:35.962436 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:35.962345 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-cert\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.063699 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.063661 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-metrics-cert\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.063699 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.063704 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-cert\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.063921 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.063849 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-manager-config\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.063921 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.063905 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f6rc\" (UniqueName: \"kubernetes.io/projected/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-kube-api-access-8f6rc\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.064523 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.064491 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-manager-config\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.066282 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.066254 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-cert\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.066373 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.066286 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-metrics-cert\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.073741 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.073711 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f6rc\" (UniqueName: \"kubernetes.io/projected/5e0f3b69-11f5-4b83-a3cb-38bcddb3d683-kube-api-access-8f6rc\") pod \"lws-controller-manager-7fcc859b85-nnvkg\" (UID: \"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683\") " pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.185736 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.185694 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:36.356433 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.356394 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg"] Jun 03 19:30:36.359284 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:30:36.359252 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0f3b69_11f5_4b83_a3cb_38bcddb3d683.slice/crio-1b32486f1fd66834e6d9a407785482e5e9499eb5ca75987debf232951ca5b67b WatchSource:0}: Error finding container 1b32486f1fd66834e6d9a407785482e5e9499eb5ca75987debf232951ca5b67b: Status 404 returned error can't find the container with id 1b32486f1fd66834e6d9a407785482e5e9499eb5ca75987debf232951ca5b67b Jun 03 19:30:36.923948 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:36.923911 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" event={"ID":"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683","Type":"ContainerStarted","Data":"1b32486f1fd66834e6d9a407785482e5e9499eb5ca75987debf232951ca5b67b"} Jun 03 19:30:38.934738 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:38.934705 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" event={"ID":"5e0f3b69-11f5-4b83-a3cb-38bcddb3d683","Type":"ContainerStarted","Data":"d25f3596dbde58ab8fe9d3d31966a34e06c1f75c72064ccd84c362653c85ea21"} Jun 03 19:30:38.935142 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:38.934834 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:30:38.975054 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:38.974930 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" podStartSLOduration=1.634634683 podStartE2EDuration="3.974913041s" totalImagesPullingTime="2.340278358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:38.972166574 +0000 UTC m=+588.712078665" watchObservedRunningTime="2026-06-03 19:30:38.974913041 +0000 UTC m=+588.714825155" Jun 03 19:30:43.403273 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.403238 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d68c4fc59-w2496"] Jun 03 19:30:43.405532 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.405512 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.409527 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.409508 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:30:43.411202 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.411177 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:30:43.411303 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.411218 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 19:30:43.411303 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.411242 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 19:30:43.411303 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.411221 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cwh4w\"" Jun 03 19:30:43.422864 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.422837 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d68c4fc59-w2496"] Jun 03 19:30:43.529825 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.529784 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27eae7bf-a027-4658-becf-c0111c849da6-tmp\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.529998 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.529834 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27eae7bf-a027-4658-becf-c0111c849da6-tls-certs\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.529998 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.529937 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8v4j\" (UniqueName: \"kubernetes.io/projected/27eae7bf-a027-4658-becf-c0111c849da6-kube-api-access-j8v4j\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.631305 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.631262 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27eae7bf-a027-4658-becf-c0111c849da6-tmp\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.631305 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.631308 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27eae7bf-a027-4658-becf-c0111c849da6-tls-certs\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.631502 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.631371 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v4j\" (UniqueName: \"kubernetes.io/projected/27eae7bf-a027-4658-becf-c0111c849da6-kube-api-access-j8v4j\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.633624 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.633597 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27eae7bf-a027-4658-becf-c0111c849da6-tmp\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.633832 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.633814 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27eae7bf-a027-4658-becf-c0111c849da6-tls-certs\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.641660 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.641639 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v4j\" (UniqueName: \"kubernetes.io/projected/27eae7bf-a027-4658-becf-c0111c849da6-kube-api-access-j8v4j\") pod \"kube-auth-proxy-d68c4fc59-w2496\" (UID: \"27eae7bf-a027-4658-becf-c0111c849da6\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.716539 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.716442 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" Jun 03 19:30:43.846644 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.846621 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d68c4fc59-w2496"] Jun 03 19:30:43.848878 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:30:43.848849 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27eae7bf_a027_4658_becf_c0111c849da6.slice/crio-d48622435085536bb5576517a37e15a6bb39d20e3068b481eed1e98e6b1b9fdc WatchSource:0}: Error finding container d48622435085536bb5576517a37e15a6bb39d20e3068b481eed1e98e6b1b9fdc: Status 404 returned error can't find the container with id d48622435085536bb5576517a37e15a6bb39d20e3068b481eed1e98e6b1b9fdc Jun 03 19:30:43.956766 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:43.956729 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" event={"ID":"27eae7bf-a027-4658-becf-c0111c849da6","Type":"ContainerStarted","Data":"d48622435085536bb5576517a37e15a6bb39d20e3068b481eed1e98e6b1b9fdc"} Jun 03 19:30:46.974442 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:46.974405 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" event={"ID":"27eae7bf-a027-4658-becf-c0111c849da6","Type":"ContainerStarted","Data":"50af6ffe7858adbe7b6fd33b581133ee20d9f942b3168f42173ee838a3b65077"} Jun 03 19:30:47.009189 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:47.009137 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-w2496" podStartSLOduration=1.023198524 podStartE2EDuration="4.009121184s" totalImagesPullingTime="2.98592266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:47.007751642 +0000 UTC m=+596.747663743" watchObservedRunningTime="2026-06-03 19:30:47.009121184 +0000 UTC m=+596.749033265" Jun 03 19:30:49.941289 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:30:49.941259 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fcc859b85-nnvkg" Jun 03 19:31:50.705417 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:31:50.705387 2550 scope.go:117] "RemoveContainer" containerID="c2eb44ce0e2073b931c0c34f0cd49f9d6df6d5c82325eac934e25e5a342d2487" Jun 03 19:32:14.735902 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.735866 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn"] Jun 03 19:32:14.739055 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.739025 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:14.742485 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.742455 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:32:14.742593 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.742502 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:32:14.743885 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.743868 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qmww6\"" Jun 03 19:32:14.750415 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.750393 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn"] Jun 03 19:32:14.814092 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.814058 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8fd\" (UniqueName: \"kubernetes.io/projected/071a3da9-6dd5-46c9-b415-43eba3ea6564-kube-api-access-wb8fd\") pod \"authorino-operator-75cc8d5cb7-fdvbn\" (UID: \"071a3da9-6dd5-46c9-b415-43eba3ea6564\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:14.914792 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.914756 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8fd\" (UniqueName: \"kubernetes.io/projected/071a3da9-6dd5-46c9-b415-43eba3ea6564-kube-api-access-wb8fd\") pod \"authorino-operator-75cc8d5cb7-fdvbn\" (UID: \"071a3da9-6dd5-46c9-b415-43eba3ea6564\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:14.924851 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:14.924820 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8fd\" (UniqueName: \"kubernetes.io/projected/071a3da9-6dd5-46c9-b415-43eba3ea6564-kube-api-access-wb8fd\") pod \"authorino-operator-75cc8d5cb7-fdvbn\" (UID: \"071a3da9-6dd5-46c9-b415-43eba3ea6564\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:15.049472 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:15.049159 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:15.181686 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:15.181652 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn"] Jun 03 19:32:15.186136 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:32:15.186103 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071a3da9_6dd5_46c9_b415_43eba3ea6564.slice/crio-9b3a30a5ae88ae4b366957aef992b4baf90e642b2aff5ee92c743dece292fedc WatchSource:0}: Error finding container 9b3a30a5ae88ae4b366957aef992b4baf90e642b2aff5ee92c743dece292fedc: Status 404 returned error can't find the container with id 9b3a30a5ae88ae4b366957aef992b4baf90e642b2aff5ee92c743dece292fedc Jun 03 19:32:15.189089 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:15.189058 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:32:15.340310 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:15.340227 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" event={"ID":"071a3da9-6dd5-46c9-b415-43eba3ea6564","Type":"ContainerStarted","Data":"9b3a30a5ae88ae4b366957aef992b4baf90e642b2aff5ee92c743dece292fedc"} Jun 03 19:32:18.356515 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:18.356479 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" event={"ID":"071a3da9-6dd5-46c9-b415-43eba3ea6564","Type":"ContainerStarted","Data":"e1261932235dce79fda246e59bfa1ae10c043330dbff4266595b8dc9cf3d1291"} Jun 03 19:32:18.356906 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:18.356585 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:18.387978 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:18.387911 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" podStartSLOduration=2.005935794 podStartE2EDuration="4.387893457s" totalImagesPullingTime="2.381957663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:18.386439159 +0000 UTC m=+688.126351226" watchObservedRunningTime="2026-06-03 19:32:18.387893457 +0000 UTC m=+688.127805544" Jun 03 19:32:20.948255 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:20.948217 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d825j"] Jun 03 19:32:20.951865 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:20.951843 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:20.954664 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:20.954641 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 19:32:20.954804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:20.954756 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dmfm7\"" Jun 03 19:32:20.954804 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:20.954783 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 19:32:20.963001 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:20.962979 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d825j"] Jun 03 19:32:21.069668 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.069633 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89f30ffe-406c-4021-b60c-bf5bfd00f42c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.069668 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.069670 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89f30ffe-406c-4021-b60c-bf5bfd00f42c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.069887 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.069699 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tmnd\" (UniqueName: \"kubernetes.io/projected/89f30ffe-406c-4021-b60c-bf5bfd00f42c-kube-api-access-4tmnd\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.170186 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.170151 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89f30ffe-406c-4021-b60c-bf5bfd00f42c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.170186 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.170186 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89f30ffe-406c-4021-b60c-bf5bfd00f42c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.170431 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.170222 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tmnd\" (UniqueName: \"kubernetes.io/projected/89f30ffe-406c-4021-b60c-bf5bfd00f42c-kube-api-access-4tmnd\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.170808 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.170788 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89f30ffe-406c-4021-b60c-bf5bfd00f42c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.172623 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.172601 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89f30ffe-406c-4021-b60c-bf5bfd00f42c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.189557 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.189528 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tmnd\" (UniqueName: \"kubernetes.io/projected/89f30ffe-406c-4021-b60c-bf5bfd00f42c-kube-api-access-4tmnd\") pod \"kuadrant-console-plugin-66b5774985-d825j\" (UID: \"89f30ffe-406c-4021-b60c-bf5bfd00f42c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.261379 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.261299 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" Jun 03 19:32:21.390772 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:21.390748 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d825j"] Jun 03 19:32:21.393603 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:32:21.393569 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89f30ffe_406c_4021_b60c_bf5bfd00f42c.slice/crio-74e31b8a0ad83e73365c92b2d8ea0663ceb1208b76d66f64f313eaadfae9d8f9 WatchSource:0}: Error finding container 74e31b8a0ad83e73365c92b2d8ea0663ceb1208b76d66f64f313eaadfae9d8f9: Status 404 returned error can't find the container with id 74e31b8a0ad83e73365c92b2d8ea0663ceb1208b76d66f64f313eaadfae9d8f9 Jun 03 19:32:22.377685 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:22.377646 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" event={"ID":"89f30ffe-406c-4021-b60c-bf5bfd00f42c","Type":"ContainerStarted","Data":"74e31b8a0ad83e73365c92b2d8ea0663ceb1208b76d66f64f313eaadfae9d8f9"} Jun 03 19:32:29.363086 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:29.363054 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdvbn" Jun 03 19:32:46.492549 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:46.492513 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" event={"ID":"89f30ffe-406c-4021-b60c-bf5bfd00f42c","Type":"ContainerStarted","Data":"4b41c0e0e7e08316de7abc3624e2b342111c6ab4603d592a8e45278d06ca2611"} Jun 03 19:32:46.514171 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:32:46.514126 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d825j" podStartSLOduration=1.962444855 podStartE2EDuration="26.514110928s" totalImagesPullingTime="24.551666073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:46.512849275 +0000 UTC m=+716.252761357" watchObservedRunningTime="2026-06-03 19:32:46.514110928 +0000 UTC m=+716.254023008" Jun 03 19:33:07.744483 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:07.744445 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7422x"] Jun 03 19:33:07.769193 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:07.769159 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7422x"] Jun 03 19:33:07.769360 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:07.769288 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:07.772450 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:07.772426 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-spck8\"" Jun 03 19:33:07.895261 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:07.895224 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnk4f\" (UniqueName: \"kubernetes.io/projected/d1fd1c47-1162-4364-ba12-39516f5214b4-kube-api-access-tnk4f\") pod \"authorino-58cd955675-7422x\" (UID: \"d1fd1c47-1162-4364-ba12-39516f5214b4\") " pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:07.996350 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:07.996262 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnk4f\" (UniqueName: \"kubernetes.io/projected/d1fd1c47-1162-4364-ba12-39516f5214b4-kube-api-access-tnk4f\") pod \"authorino-58cd955675-7422x\" (UID: \"d1fd1c47-1162-4364-ba12-39516f5214b4\") " pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:08.005483 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:08.005451 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnk4f\" (UniqueName: \"kubernetes.io/projected/d1fd1c47-1162-4364-ba12-39516f5214b4-kube-api-access-tnk4f\") pod \"authorino-58cd955675-7422x\" (UID: \"d1fd1c47-1162-4364-ba12-39516f5214b4\") " pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:08.078745 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:08.078707 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:08.244087 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:08.244063 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7422x"] Jun 03 19:33:08.246003 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:33:08.245975 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1fd1c47_1162_4364_ba12_39516f5214b4.slice/crio-79d0911bf7d302f0f8d6593a5320dbfdd0bb3263df752b6da36e91bdb2a76850 WatchSource:0}: Error finding container 79d0911bf7d302f0f8d6593a5320dbfdd0bb3263df752b6da36e91bdb2a76850: Status 404 returned error can't find the container with id 79d0911bf7d302f0f8d6593a5320dbfdd0bb3263df752b6da36e91bdb2a76850 Jun 03 19:33:08.589092 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:08.588979 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7422x" event={"ID":"d1fd1c47-1162-4364-ba12-39516f5214b4","Type":"ContainerStarted","Data":"79d0911bf7d302f0f8d6593a5320dbfdd0bb3263df752b6da36e91bdb2a76850"} Jun 03 19:33:12.435321 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:12.435284 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7422x"] Jun 03 19:33:12.612162 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:12.612118 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7422x" event={"ID":"d1fd1c47-1162-4364-ba12-39516f5214b4","Type":"ContainerStarted","Data":"5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a"} Jun 03 19:33:12.633349 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:12.633298 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7422x" podStartSLOduration=2.023961903 podStartE2EDuration="5.633281241s" totalImagesPullingTime="3.609319338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:12.632210195 +0000 UTC m=+742.372122276" watchObservedRunningTime="2026-06-03 19:33:12.633281241 +0000 UTC m=+742.373193320" Jun 03 19:33:13.616265 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:13.616224 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7422x" podUID="d1fd1c47-1162-4364-ba12-39516f5214b4" containerName="authorino" containerID="cri-o://5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a" gracePeriod=30 Jun 03 19:33:13.866344 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:13.866256 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:13.950309 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:13.950266 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnk4f\" (UniqueName: \"kubernetes.io/projected/d1fd1c47-1162-4364-ba12-39516f5214b4-kube-api-access-tnk4f\") pod \"d1fd1c47-1162-4364-ba12-39516f5214b4\" (UID: \"d1fd1c47-1162-4364-ba12-39516f5214b4\") " Jun 03 19:33:13.952645 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:13.952615 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1fd1c47-1162-4364-ba12-39516f5214b4-kube-api-access-tnk4f" (OuterVolumeSpecName: "kube-api-access-tnk4f") pod "d1fd1c47-1162-4364-ba12-39516f5214b4" (UID: "d1fd1c47-1162-4364-ba12-39516f5214b4"). InnerVolumeSpecName "kube-api-access-tnk4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:33:14.051621 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.051569 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnk4f\" (UniqueName: \"kubernetes.io/projected/d1fd1c47-1162-4364-ba12-39516f5214b4-kube-api-access-tnk4f\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:33:14.621675 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.621643 2550 generic.go:356] "Generic (PLEG): container finished" podID="d1fd1c47-1162-4364-ba12-39516f5214b4" containerID="5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a" exitCode=0 Jun 03 19:33:14.622129 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.621684 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7422x" Jun 03 19:33:14.622129 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.621704 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7422x" event={"ID":"d1fd1c47-1162-4364-ba12-39516f5214b4","Type":"ContainerDied","Data":"5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a"} Jun 03 19:33:14.622129 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.621735 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7422x" event={"ID":"d1fd1c47-1162-4364-ba12-39516f5214b4","Type":"ContainerDied","Data":"79d0911bf7d302f0f8d6593a5320dbfdd0bb3263df752b6da36e91bdb2a76850"} Jun 03 19:33:14.622129 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.621750 2550 scope.go:117] "RemoveContainer" containerID="5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a" Jun 03 19:33:14.630174 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.630152 2550 scope.go:117] "RemoveContainer" containerID="5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a" Jun 03 19:33:14.630496 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:33:14.630477 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a\": container with ID starting with 5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a not found: ID does not exist" containerID="5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a" Jun 03 19:33:14.630548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.630505 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a"} err="failed to get container status \"5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a\": rpc error: code = NotFound desc = could not find container \"5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a\": container with ID starting with 5d2ebbbf7674bcafd18a9d466be26f1bbb028754671d338b1613fe430d89970a not found: ID does not exist" Jun 03 19:33:14.643166 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.643132 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7422x"] Jun 03 19:33:14.644874 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.644847 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7422x"] Jun 03 19:33:14.729425 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:14.729389 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1fd1c47-1162-4364-ba12-39516f5214b4" path="/var/lib/kubelet/pods/d1fd1c47-1162-4364-ba12-39516f5214b4/volumes" Jun 03 19:33:52.887386 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.887351 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-8mbkx"] Jun 03 19:33:52.887820 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.887692 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1fd1c47-1162-4364-ba12-39516f5214b4" containerName="authorino" Jun 03 19:33:52.887820 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.887705 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1fd1c47-1162-4364-ba12-39516f5214b4" containerName="authorino" Jun 03 19:33:52.887820 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.887762 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1fd1c47-1162-4364-ba12-39516f5214b4" containerName="authorino" Jun 03 19:33:52.893956 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.893936 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" Jun 03 19:33:52.897249 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.897226 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 19:33:52.898797 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.898776 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-6458t\"" Jun 03 19:33:52.898925 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.898838 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 19:33:52.901228 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.900962 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-8mbkx"] Jun 03 19:33:52.985263 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:52.985226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krd6q\" (UniqueName: \"kubernetes.io/projected/21f8ffa5-f4d9-4280-834f-ba37ab08df54-kube-api-access-krd6q\") pod \"keycloak-operator-dd84cbf46-8mbkx\" (UID: \"21f8ffa5-f4d9-4280-834f-ba37ab08df54\") " pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" Jun 03 19:33:53.086178 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:53.086132 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krd6q\" (UniqueName: \"kubernetes.io/projected/21f8ffa5-f4d9-4280-834f-ba37ab08df54-kube-api-access-krd6q\") pod \"keycloak-operator-dd84cbf46-8mbkx\" (UID: \"21f8ffa5-f4d9-4280-834f-ba37ab08df54\") " pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" Jun 03 19:33:53.100476 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:53.100436 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krd6q\" (UniqueName: \"kubernetes.io/projected/21f8ffa5-f4d9-4280-834f-ba37ab08df54-kube-api-access-krd6q\") pod \"keycloak-operator-dd84cbf46-8mbkx\" (UID: \"21f8ffa5-f4d9-4280-834f-ba37ab08df54\") " pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" Jun 03 19:33:53.204937 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:53.204853 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" Jun 03 19:33:53.353351 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:53.353246 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-8mbkx"] Jun 03 19:33:53.355711 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:33:53.355683 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f8ffa5_f4d9_4280_834f_ba37ab08df54.slice/crio-2b90eddb2ae3336b059a6b9e76633fabf820390ddd578ec98144c36360ab30e5 WatchSource:0}: Error finding container 2b90eddb2ae3336b059a6b9e76633fabf820390ddd578ec98144c36360ab30e5: Status 404 returned error can't find the container with id 2b90eddb2ae3336b059a6b9e76633fabf820390ddd578ec98144c36360ab30e5 Jun 03 19:33:53.787133 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:53.787085 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" event={"ID":"21f8ffa5-f4d9-4280-834f-ba37ab08df54","Type":"ContainerStarted","Data":"2b90eddb2ae3336b059a6b9e76633fabf820390ddd578ec98144c36360ab30e5"} Jun 03 19:33:59.818714 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:59.818681 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" event={"ID":"21f8ffa5-f4d9-4280-834f-ba37ab08df54","Type":"ContainerStarted","Data":"f9b642c14b1f3df76facb821bd9126bba77e094f0ec62eeca994f32335bdb3c6"} Jun 03 19:33:59.836771 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:33:59.836724 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-8mbkx" podStartSLOduration=1.9683226029999998 podStartE2EDuration="7.836710117s" totalImagesPullingTime="5.868387514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:59.835870228 +0000 UTC m=+789.575782309" watchObservedRunningTime="2026-06-03 19:33:59.836710117 +0000 UTC m=+789.576622198" Jun 03 19:34:39.305003 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.304972 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bfcd7dbc5-wkprp"] Jun 03 19:34:39.307143 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.307125 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.312121 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.312103 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 19:34:39.312227 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.312124 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-spck8\"" Jun 03 19:34:39.319514 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.319492 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bfcd7dbc5-wkprp"] Jun 03 19:34:39.364699 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.364676 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-tls-cert\") pod \"authorino-5bfcd7dbc5-wkprp\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.364810 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.364707 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdktc\" (UniqueName: \"kubernetes.io/projected/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-kube-api-access-cdktc\") pod \"authorino-5bfcd7dbc5-wkprp\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.465687 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.465660 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-tls-cert\") pod \"authorino-5bfcd7dbc5-wkprp\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.465778 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.465690 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdktc\" (UniqueName: \"kubernetes.io/projected/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-kube-api-access-cdktc\") pod \"authorino-5bfcd7dbc5-wkprp\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.468057 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.468024 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-tls-cert\") pod \"authorino-5bfcd7dbc5-wkprp\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.474897 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.474878 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdktc\" (UniqueName: \"kubernetes.io/projected/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-kube-api-access-cdktc\") pod \"authorino-5bfcd7dbc5-wkprp\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.616200 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.616176 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:34:39.739279 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.739254 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bfcd7dbc5-wkprp"] Jun 03 19:34:39.741436 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:34:39.741411 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a046c4_006b_44d0_bcd6_d7ea451bbd4e.slice/crio-ca66370da45f08af7008e0a1cf28e2a9cf33f10cc8b3254eddef1bfff5c2b414 WatchSource:0}: Error finding container ca66370da45f08af7008e0a1cf28e2a9cf33f10cc8b3254eddef1bfff5c2b414: Status 404 returned error can't find the container with id ca66370da45f08af7008e0a1cf28e2a9cf33f10cc8b3254eddef1bfff5c2b414 Jun 03 19:34:39.982345 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:39.982266 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" event={"ID":"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e","Type":"ContainerStarted","Data":"ca66370da45f08af7008e0a1cf28e2a9cf33f10cc8b3254eddef1bfff5c2b414"} Jun 03 19:34:40.987922 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:40.987888 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" event={"ID":"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e","Type":"ContainerStarted","Data":"58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a"} Jun 03 19:34:41.007017 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:34:41.006972 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" podStartSLOduration=1.610858494 podStartE2EDuration="2.006956917s" totalImagesPullingTime="396.098423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:41.005618277 +0000 UTC m=+830.745530377" watchObservedRunningTime="2026-06-03 19:34:41.006956917 +0000 UTC m=+830.746868997" Jun 03 19:36:10.426960 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.426926 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bfcd7dbc5-wkprp"] Jun 03 19:36:10.427485 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.427113 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" podUID="a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" containerName="authorino" containerID="cri-o://58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a" gracePeriod=30 Jun 03 19:36:10.681117 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.681055 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:36:10.714311 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.714286 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdktc\" (UniqueName: \"kubernetes.io/projected/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-kube-api-access-cdktc\") pod \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " Jun 03 19:36:10.714479 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.714339 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-tls-cert\") pod \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\" (UID: \"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e\") " Jun 03 19:36:10.716466 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.716438 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-kube-api-access-cdktc" (OuterVolumeSpecName: "kube-api-access-cdktc") pod "a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" (UID: "a6a046c4-006b-44d0-bcd6-d7ea451bbd4e"). InnerVolumeSpecName "kube-api-access-cdktc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:10.723474 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.723450 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" (UID: "a6a046c4-006b-44d0-bcd6-d7ea451bbd4e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:10.815256 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.815224 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdktc\" (UniqueName: \"kubernetes.io/projected/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-kube-api-access-cdktc\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.815256 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:10.815252 2550 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e-tls-cert\") on node \"ip-10-0-129-220.ec2.internal\" DevicePath \"\"" Jun 03 19:36:11.377708 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.377664 2550 generic.go:356] "Generic (PLEG): container finished" podID="a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" containerID="58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a" exitCode=0 Jun 03 19:36:11.377918 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.377723 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" Jun 03 19:36:11.377918 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.377749 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" event={"ID":"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e","Type":"ContainerDied","Data":"58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a"} Jun 03 19:36:11.377918 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.377804 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bfcd7dbc5-wkprp" event={"ID":"a6a046c4-006b-44d0-bcd6-d7ea451bbd4e","Type":"ContainerDied","Data":"ca66370da45f08af7008e0a1cf28e2a9cf33f10cc8b3254eddef1bfff5c2b414"} Jun 03 19:36:11.377918 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.377825 2550 scope.go:117] "RemoveContainer" containerID="58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a" Jun 03 19:36:11.386210 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.386184 2550 scope.go:117] "RemoveContainer" containerID="58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a" Jun 03 19:36:11.386448 ip-10-0-129-220 kubenswrapper[2550]: E0603 19:36:11.386429 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a\": container with ID starting with 58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a not found: ID does not exist" containerID="58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a" Jun 03 19:36:11.386492 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.386459 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a"} err="failed to get container status \"58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a\": rpc error: code = NotFound desc = could not find container \"58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a\": container with ID starting with 58b4ff79d2498324d2ae0252b0e990d711e34909b20677e3493831920729782a not found: ID does not exist" Jun 03 19:36:11.399873 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.399848 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bfcd7dbc5-wkprp"] Jun 03 19:36:11.404172 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:11.404152 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bfcd7dbc5-wkprp"] Jun 03 19:36:12.729658 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:12.729614 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" path="/var/lib/kubelet/pods/a6a046c4-006b-44d0-bcd6-d7ea451bbd4e/volumes" Jun 03 19:36:39.941746 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.941714 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt"] Jun 03 19:36:39.944093 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.942114 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" containerName="authorino" Jun 03 19:36:39.944093 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.942131 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" containerName="authorino" Jun 03 19:36:39.944093 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.942263 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a046c4-006b-44d0-bcd6-d7ea451bbd4e" containerName="authorino" Jun 03 19:36:39.945654 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.945630 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:39.949426 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.949379 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 19:36:39.950979 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.950950 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 19:36:39.951117 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.950990 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 19:36:39.951117 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.950958 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rtlr7\"" Jun 03 19:36:39.963869 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:39.963842 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt"] Jun 03 19:36:40.054684 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.054637 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.054889 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.054689 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.054889 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.054715 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqs9s\" (UniqueName: \"kubernetes.io/projected/551cfb96-1126-4fef-80ef-2d7258a64f4a-kube-api-access-xqs9s\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.054889 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.054751 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.054889 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.054773 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.054889 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.054861 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551cfb96-1126-4fef-80ef-2d7258a64f4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156232 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156191 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551cfb96-1126-4fef-80ef-2d7258a64f4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156250 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156270 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156293 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqs9s\" (UniqueName: \"kubernetes.io/projected/551cfb96-1126-4fef-80ef-2d7258a64f4a-kube-api-access-xqs9s\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156329 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156430 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156344 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156701 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156663 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156751 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156703 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.156806 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.156787 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.158739 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.158712 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/551cfb96-1126-4fef-80ef-2d7258a64f4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.158908 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.158889 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551cfb96-1126-4fef-80ef-2d7258a64f4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.167082 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.167022 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqs9s\" (UniqueName: \"kubernetes.io/projected/551cfb96-1126-4fef-80ef-2d7258a64f4a-kube-api-access-xqs9s\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt\" (UID: \"551cfb96-1126-4fef-80ef-2d7258a64f4a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.257550 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.257460 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:40.388519 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.388492 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt"] Jun 03 19:36:40.390733 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:36:40.390699 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551cfb96_1126_4fef_80ef_2d7258a64f4a.slice/crio-50b83f145d6c90632c22449618969f452f938fea553893a256ad1d65d0d06549 WatchSource:0}: Error finding container 50b83f145d6c90632c22449618969f452f938fea553893a256ad1d65d0d06549: Status 404 returned error can't find the container with id 50b83f145d6c90632c22449618969f452f938fea553893a256ad1d65d0d06549 Jun 03 19:36:40.509267 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:40.509181 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" event={"ID":"551cfb96-1126-4fef-80ef-2d7258a64f4a","Type":"ContainerStarted","Data":"50b83f145d6c90632c22449618969f452f938fea553893a256ad1d65d0d06549"} Jun 03 19:36:43.524622 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:43.524584 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" event={"ID":"551cfb96-1126-4fef-80ef-2d7258a64f4a","Type":"ContainerStarted","Data":"7595d411f70bce852a028a84e94c8ced5286b5186e84cb1ecfef90093b89642e"} Jun 03 19:36:45.535115 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:45.535071 2550 generic.go:356] "Generic (PLEG): container finished" podID="551cfb96-1126-4fef-80ef-2d7258a64f4a" containerID="7595d411f70bce852a028a84e94c8ced5286b5186e84cb1ecfef90093b89642e" exitCode=0 Jun 03 19:36:45.535505 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:45.535145 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" event={"ID":"551cfb96-1126-4fef-80ef-2d7258a64f4a","Type":"ContainerDied","Data":"7595d411f70bce852a028a84e94c8ced5286b5186e84cb1ecfef90093b89642e"} Jun 03 19:36:47.547632 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:47.547587 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" event={"ID":"551cfb96-1126-4fef-80ef-2d7258a64f4a","Type":"ContainerStarted","Data":"6bb1bfe41df301114fa1cf0ef072637125f8a17f1ab579eb13dbbfc25e6b94bf"} Jun 03 19:36:47.570679 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:47.570625 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" podStartSLOduration=3.299609654 podStartE2EDuration="8.570609535s" totalImagesPullingTime="4.067780162s" totalInitContainerRuntime="1.203219719s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:47.568889407 +0000 UTC m=+957.308801488" watchObservedRunningTime="2026-06-03 19:36:47.570609535 +0000 UTC m=+957.310521616" Jun 03 19:36:50.257857 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:50.257819 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:50.258374 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:50.257892 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:50.270539 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:50.270513 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:36:50.571529 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:36:50.571457 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt" Jun 03 19:37:00.941023 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:00.940989 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x"] Jun 03 19:37:00.960013 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:00.959978 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:00.962543 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:00.962509 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x"] Jun 03 19:37:00.964270 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:00.964248 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 19:37:01.139750 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.139707 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b92e7f58-9974-466f-be3d-27bc34d5042b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.139750 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.139752 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.139967 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.139779 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.139967 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.139830 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.139967 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.139861 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.139967 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.139892 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfq6x\" (UniqueName: \"kubernetes.io/projected/b92e7f58-9974-466f-be3d-27bc34d5042b-kube-api-access-nfq6x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241333 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241244 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241333 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241294 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfq6x\" (UniqueName: \"kubernetes.io/projected/b92e7f58-9974-466f-be3d-27bc34d5042b-kube-api-access-nfq6x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241333 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241332 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b92e7f58-9974-466f-be3d-27bc34d5042b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241600 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241352 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241600 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241374 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241600 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241526 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241817 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241795 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241882 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241829 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.241934 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.241861 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.243647 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.243629 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b92e7f58-9974-466f-be3d-27bc34d5042b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.243826 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.243808 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b92e7f58-9974-466f-be3d-27bc34d5042b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.251542 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.251522 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfq6x\" (UniqueName: \"kubernetes.io/projected/b92e7f58-9974-466f-be3d-27bc34d5042b-kube-api-access-nfq6x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x\" (UID: \"b92e7f58-9974-466f-be3d-27bc34d5042b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.271511 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.271482 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:01.407750 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.407721 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x"] Jun 03 19:37:01.410153 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:37:01.410126 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92e7f58_9974_466f_be3d_27bc34d5042b.slice/crio-1b2a1754199cd924b82162fec1cb99717b9fb311d4f4ec29954d933bc2c235e9 WatchSource:0}: Error finding container 1b2a1754199cd924b82162fec1cb99717b9fb311d4f4ec29954d933bc2c235e9: Status 404 returned error can't find the container with id 1b2a1754199cd924b82162fec1cb99717b9fb311d4f4ec29954d933bc2c235e9 Jun 03 19:37:01.609714 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.609631 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" event={"ID":"b92e7f58-9974-466f-be3d-27bc34d5042b","Type":"ContainerStarted","Data":"c1e398a92c15934316288b6f9cba839a4450ecabf2a5f4a777c48bff71691cce"} Jun 03 19:37:01.609714 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:01.609683 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" event={"ID":"b92e7f58-9974-466f-be3d-27bc34d5042b","Type":"ContainerStarted","Data":"1b2a1754199cd924b82162fec1cb99717b9fb311d4f4ec29954d933bc2c235e9"} Jun 03 19:37:03.618940 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:03.618905 2550 generic.go:356] "Generic (PLEG): container finished" podID="b92e7f58-9974-466f-be3d-27bc34d5042b" containerID="c1e398a92c15934316288b6f9cba839a4450ecabf2a5f4a777c48bff71691cce" exitCode=0 Jun 03 19:37:03.619365 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:03.618982 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" event={"ID":"b92e7f58-9974-466f-be3d-27bc34d5042b","Type":"ContainerDied","Data":"c1e398a92c15934316288b6f9cba839a4450ecabf2a5f4a777c48bff71691cce"} Jun 03 19:37:04.625492 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:04.625460 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" event={"ID":"b92e7f58-9974-466f-be3d-27bc34d5042b","Type":"ContainerStarted","Data":"a43fd9252559e9a6fc805dbb1c4ce0070cf4b82f93c6a34186526228ec6a668d"} Jun 03 19:37:04.647719 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:04.647665 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" podStartSLOduration=3.222395622 podStartE2EDuration="4.647649874s" totalImagesPullingTime="215.109762ms" totalInitContainerRuntime="1.21014449s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:04.646979694 +0000 UTC m=+974.386891777" watchObservedRunningTime="2026-06-03 19:37:04.647649874 +0000 UTC m=+974.387561956" Jun 03 19:37:09.651330 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.651299 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54"] Jun 03 19:37:09.654706 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.654689 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.658196 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.658174 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 19:37:09.666635 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.666611 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54"] Jun 03 19:37:09.718561 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.718530 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.718727 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.718577 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flrwf\" (UniqueName: \"kubernetes.io/projected/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-kube-api-access-flrwf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.718727 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.718615 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.718727 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.718654 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.718727 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.718712 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.718860 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.718761 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819293 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819253 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819293 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819294 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819335 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flrwf\" (UniqueName: \"kubernetes.io/projected/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-kube-api-access-flrwf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819366 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819548 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819476 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819702 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819587 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819702 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819686 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.819963 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.819936 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.820176 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.820000 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.821695 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.821675 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.821800 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.821781 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.829104 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.829083 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flrwf\" (UniqueName: \"kubernetes.io/projected/ee84889d-fcbb-49d5-a5f5-c7682dff4a03-kube-api-access-flrwf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lhz54\" (UID: \"ee84889d-fcbb-49d5-a5f5-c7682dff4a03\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:09.963586 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:09.963495 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:10.097467 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:10.097443 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54"] Jun 03 19:37:10.099676 ip-10-0-129-220 kubenswrapper[2550]: W0603 19:37:10.099651 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee84889d_fcbb_49d5_a5f5_c7682dff4a03.slice/crio-fe1ab4119ee02bebddae652822cb441950296caea5e14722e461bc68b738c5a8 WatchSource:0}: Error finding container fe1ab4119ee02bebddae652822cb441950296caea5e14722e461bc68b738c5a8: Status 404 returned error can't find the container with id fe1ab4119ee02bebddae652822cb441950296caea5e14722e461bc68b738c5a8 Jun 03 19:37:10.659179 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:10.659145 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" event={"ID":"ee84889d-fcbb-49d5-a5f5-c7682dff4a03","Type":"ContainerStarted","Data":"8305b291ede0b1adb7db78acb34687e77e5fd6b7e9e216faee37a2a2b4c70233"} Jun 03 19:37:10.659179 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:10.659186 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" event={"ID":"ee84889d-fcbb-49d5-a5f5-c7682dff4a03","Type":"ContainerStarted","Data":"fe1ab4119ee02bebddae652822cb441950296caea5e14722e461bc68b738c5a8"} Jun 03 19:37:11.272353 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:11.272318 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:11.272555 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:11.272382 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:11.284645 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:11.284618 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:11.665019 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:11.664987 2550 generic.go:356] "Generic (PLEG): container finished" podID="ee84889d-fcbb-49d5-a5f5-c7682dff4a03" containerID="8305b291ede0b1adb7db78acb34687e77e5fd6b7e9e216faee37a2a2b4c70233" exitCode=0 Jun 03 19:37:11.665477 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:11.665066 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" event={"ID":"ee84889d-fcbb-49d5-a5f5-c7682dff4a03","Type":"ContainerDied","Data":"8305b291ede0b1adb7db78acb34687e77e5fd6b7e9e216faee37a2a2b4c70233"} Jun 03 19:37:11.676525 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:11.676492 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x" Jun 03 19:37:12.672132 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:12.672086 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" event={"ID":"ee84889d-fcbb-49d5-a5f5-c7682dff4a03","Type":"ContainerStarted","Data":"5a07e834721bb4b79eb8bb941949774215ed3c45545b1870cfe778c459252818"} Jun 03 19:37:12.693362 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:12.693306 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" podStartSLOduration=2.242118682 podStartE2EDuration="3.693291605s" totalImagesPullingTime="239.013724ms" totalInitContainerRuntime="1.212159199s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:12.691503515 +0000 UTC m=+982.431415622" watchObservedRunningTime="2026-06-03 19:37:12.693291605 +0000 UTC m=+982.433203685" Jun 03 19:37:19.964129 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:19.964083 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:19.964718 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:19.964142 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:19.976390 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:19.976364 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 19:37:20.720164 ip-10-0-129-220 kubenswrapper[2550]: I0603 19:37:20.720137 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lhz54" Jun 03 20:01:19.552575 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:19.552491 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-ck7fv_27e7b76e-1b6c-4107-8f4a-0beae1b44d23/copy-manifests/0.log" Jun 03 20:01:19.560308 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:19.560274 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-ck7fv_27e7b76e-1b6c-4107-8f4a-0beae1b44d23/manager/0.log" Jun 03 20:01:21.328225 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:21.328118 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fdvbn_071a3da9-6dd5-46c9-b415-43eba3ea6564/manager/0.log" Jun 03 20:01:21.550888 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:21.550857 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d825j_89f30ffe-406c-4021-b60c-bf5bfd00f42c/kuadrant-console-plugin/0.log" Jun 03 20:01:22.696262 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:22.696231 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-w2496_27eae7bf-a027-4658-becf-c0111c849da6/kube-auth-proxy/0.log" Jun 03 20:01:23.660655 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:23.660620 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt_551cfb96-1126-4fef-80ef-2d7258a64f4a/storage-initializer/0.log" Jun 03 20:01:23.668065 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:23.668042 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fhgvt_551cfb96-1126-4fef-80ef-2d7258a64f4a/main/0.log" Jun 03 20:01:23.902609 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:23.902573 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x_b92e7f58-9974-466f-be3d-27bc34d5042b/storage-initializer/0.log" Jun 03 20:01:23.909560 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:23.909529 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-pwj9x_b92e7f58-9974-466f-be3d-27bc34d5042b/main/0.log" Jun 03 20:01:24.020906 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:24.020823 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lhz54_ee84889d-fcbb-49d5-a5f5-c7682dff4a03/storage-initializer/0.log" Jun 03 20:01:24.027712 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:24.027684 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lhz54_ee84889d-fcbb-49d5-a5f5-c7682dff4a03/main/0.log" Jun 03 20:01:31.397457 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:31.397431 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9mnv9_a28252b2-300b-4164-8967-7a686cce1551/global-pull-secret-syncer/0.log" Jun 03 20:01:31.679641 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:31.679555 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-st6xc_f89672f0-b4e2-4b38-a251-0a6f0aae67bc/konnectivity-agent/0.log" Jun 03 20:01:31.704368 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:31.704335 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-220.ec2.internal_172208cb942795fc0463350e6867edd8/haproxy/0.log" Jun 03 20:01:36.579491 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:36.579460 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fdvbn_071a3da9-6dd5-46c9-b415-43eba3ea6564/manager/0.log" Jun 03 20:01:36.640397 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:36.640366 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d825j_89f30ffe-406c-4021-b60c-bf5bfd00f42c/kuadrant-console-plugin/0.log" Jun 03 20:01:38.649952 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:38.649914 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jfgsg_7e009862-4506-4ad4-b330-c20f2dd53b59/kube-state-metrics/0.log" Jun 03 20:01:38.672834 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:38.672810 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jfgsg_7e009862-4506-4ad4-b330-c20f2dd53b59/kube-rbac-proxy-main/0.log" Jun 03 20:01:38.700191 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:38.700163 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jfgsg_7e009862-4506-4ad4-b330-c20f2dd53b59/kube-rbac-proxy-self/0.log" Jun 03 20:01:38.997668 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:38.997626 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brbrx_62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43/node-exporter/0.log" Jun 03 20:01:39.018389 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.018363 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brbrx_62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43/kube-rbac-proxy/0.log" Jun 03 20:01:39.048075 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.048026 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brbrx_62d9a27b-2c8a-46fc-a07f-d64f9ed5ec43/init-textfile/0.log" Jun 03 20:01:39.076170 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.076140 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qbbfk_629cca99-1fe9-486f-93e6-0700079efea4/kube-rbac-proxy-main/0.log" Jun 03 20:01:39.100278 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.100250 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qbbfk_629cca99-1fe9-486f-93e6-0700079efea4/kube-rbac-proxy-self/0.log" Jun 03 20:01:39.126525 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.126495 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qbbfk_629cca99-1fe9-486f-93e6-0700079efea4/openshift-state-metrics/0.log" Jun 03 20:01:39.201873 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.201799 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/prometheus/0.log" Jun 03 20:01:39.232664 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.232621 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/config-reloader/0.log" Jun 03 20:01:39.268239 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.268210 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/thanos-sidecar/0.log" Jun 03 20:01:39.293715 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.293685 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/kube-rbac-proxy-web/0.log" Jun 03 20:01:39.318660 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.318634 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/kube-rbac-proxy/0.log" Jun 03 20:01:39.343164 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.343139 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/kube-rbac-proxy-thanos/0.log" Jun 03 20:01:39.374989 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.374965 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cbf4c919-3b06-40b4-ae9d-49414ae19d60/init-config-reloader/0.log" Jun 03 20:01:39.478708 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:39.478632 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-tll5p_5f5bfee7-5c04-4a0a-b4d1-55d304611bc1/prometheus-operator-admission-webhook/0.log" Jun 03 20:01:43.769752 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.769717 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx"] Jun 03 20:01:43.773345 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.773320 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.776686 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.776666 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfrrm\"/\"kube-root-ca.crt\"" Jun 03 20:01:43.778110 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.778093 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sfrrm\"/\"default-dockercfg-h4xnk\"" Jun 03 20:01:43.778157 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.778094 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfrrm\"/\"openshift-service-ca.crt\"" Jun 03 20:01:43.784810 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.784780 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx"] Jun 03 20:01:43.800671 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.800628 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-podres\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.800847 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.800686 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-lib-modules\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.800847 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.800825 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st8dd\" (UniqueName: \"kubernetes.io/projected/d6bc4c45-ab76-4dce-9209-41225dee0fd1-kube-api-access-st8dd\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.800949 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.800907 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-sys\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.800999 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.800962 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-proc\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.901791 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901749 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-podres\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.901791 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901791 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-lib-modules\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901833 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st8dd\" (UniqueName: \"kubernetes.io/projected/d6bc4c45-ab76-4dce-9209-41225dee0fd1-kube-api-access-st8dd\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901862 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-sys\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901883 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-proc\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901931 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-podres\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.901987 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-sys\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.902020 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-lib-modules\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.902083 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.902021 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6bc4c45-ab76-4dce-9209-41225dee0fd1-proc\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:43.912431 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:43.912399 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st8dd\" (UniqueName: \"kubernetes.io/projected/d6bc4c45-ab76-4dce-9209-41225dee0fd1-kube-api-access-st8dd\") pod \"perf-node-gather-daemonset-q2xrx\" (UID: \"d6bc4c45-ab76-4dce-9209-41225dee0fd1\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:44.083871 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.083763 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:44.225176 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.225077 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx"] Jun 03 20:01:44.227665 ip-10-0-129-220 kubenswrapper[2550]: W0603 20:01:44.227629 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd6bc4c45_ab76_4dce_9209_41225dee0fd1.slice/crio-6e1a1a1767444761c86aa60e8e7ba0eb5de2dd254bfa06116f0e435d79094f00 WatchSource:0}: Error finding container 6e1a1a1767444761c86aa60e8e7ba0eb5de2dd254bfa06116f0e435d79094f00: Status 404 returned error can't find the container with id 6e1a1a1767444761c86aa60e8e7ba0eb5de2dd254bfa06116f0e435d79094f00 Jun 03 20:01:44.449681 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.449633 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" event={"ID":"d6bc4c45-ab76-4dce-9209-41225dee0fd1","Type":"ContainerStarted","Data":"ee4cf68569c80e0016bc861da7246ea39403923d082d79eedf7152dbfe6f0d3f"} Jun 03 20:01:44.449895 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.449700 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" event={"ID":"d6bc4c45-ab76-4dce-9209-41225dee0fd1","Type":"ContainerStarted","Data":"6e1a1a1767444761c86aa60e8e7ba0eb5de2dd254bfa06116f0e435d79094f00"} Jun 03 20:01:44.449895 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.449769 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:44.467205 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.467171 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gxxk_14ba38e0-2bdf-465a-a42b-396462d66803/dns/0.log" Jun 03 20:01:44.467557 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.467521 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" podStartSLOduration=1.467505681 podStartE2EDuration="1.467505681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:01:44.46573129 +0000 UTC m=+2454.205643393" watchObservedRunningTime="2026-06-03 20:01:44.467505681 +0000 UTC m=+2454.207417772" Jun 03 20:01:44.489660 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.489633 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gxxk_14ba38e0-2bdf-465a-a42b-396462d66803/kube-rbac-proxy/0.log" Jun 03 20:01:44.606677 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:44.606648 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57vsp_bd4f8689-587c-4232-b088-0d9a751ebc18/dns-node-resolver/0.log" Jun 03 20:01:45.259715 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:45.259689 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hs9n8_822c5330-5f6b-4384-9675-d7f1dd971a11/node-ca/0.log" Jun 03 20:01:46.413324 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:46.413293 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-w2496_27eae7bf-a027-4658-becf-c0111c849da6/kube-auth-proxy/0.log" Jun 03 20:01:47.335942 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:47.335911 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj7fg_6eeeeef9-9080-408c-9c37-9ba54440b411/serve-healthcheck-canary/0.log" Jun 03 20:01:47.905773 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:47.905703 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jwvcm_d4529969-5740-4207-959d-74d931a4f48d/kube-rbac-proxy/0.log" Jun 03 20:01:47.929695 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:47.929666 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jwvcm_d4529969-5740-4207-959d-74d931a4f48d/exporter/0.log" Jun 03 20:01:47.952920 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:47.952891 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jwvcm_d4529969-5740-4207-959d-74d931a4f48d/extractor/0.log" Jun 03 20:01:50.464130 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:50.464096 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-q2xrx" Jun 03 20:01:50.840585 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:50.840482 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-ck7fv_27e7b76e-1b6c-4107-8f4a-0beae1b44d23/manager/0.log" Jun 03 20:01:50.861569 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:50.861539 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-ck7fv_27e7b76e-1b6c-4107-8f4a-0beae1b44d23/copy-manifests/0.log" Jun 03 20:01:52.654073 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:52.654042 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fcc859b85-nnvkg_5e0f3b69-11f5-4b83-a3cb-38bcddb3d683/manager/0.log" Jun 03 20:01:52.679691 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:52.679646 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7k4xk_f8daa258-94a4-4c95-b484-3135eae26ac0/openshift-lws-operator/0.log" Jun 03 20:01:56.221456 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:56.221430 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-w2496_27eae7bf-a027-4658-becf-c0111c849da6/kube-auth-proxy/0.log" Jun 03 20:01:57.655975 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:57.655945 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-w2496_27eae7bf-a027-4658-becf-c0111c849da6/kube-auth-proxy/0.log" Jun 03 20:01:58.563335 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:58.563295 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-99rgd_92bd9c8e-fd12-4a1a-8efa-fbd84b89890b/migrator/0.log" Jun 03 20:01:58.584430 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:58.584393 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-99rgd_92bd9c8e-fd12-4a1a-8efa-fbd84b89890b/graceful-termination/0.log" Jun 03 20:01:59.516246 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:01:59.516214 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-w2496_27eae7bf-a027-4658-becf-c0111c849da6/kube-auth-proxy/0.log" Jun 03 20:02:00.386650 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.386623 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/kube-multus-additional-cni-plugins/0.log" Jun 03 20:02:00.407524 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.407497 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/egress-router-binary-copy/0.log" Jun 03 20:02:00.428155 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.428123 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/cni-plugins/0.log" Jun 03 20:02:00.450004 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.449977 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/bond-cni-plugin/0.log" Jun 03 20:02:00.472312 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.472285 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/routeoverride-cni/0.log" Jun 03 20:02:00.492880 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.492855 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/whereabouts-cni-bincopy/0.log" Jun 03 20:02:00.521472 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.521443 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fknl2_528914bf-a508-44f0-8c49-ae2bb5dbbd90/whereabouts-cni/0.log" Jun 03 20:02:00.728423 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.728330 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ks8kd_6ff193ad-01c5-4644-990a-635a05c8984b/kube-multus/0.log" Jun 03 20:02:00.810350 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.810299 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-25zwz_b6b625c0-e0f2-44b3-b858-7d26d8a2746f/network-metrics-daemon/0.log" Jun 03 20:02:00.833482 ip-10-0-129-220 kubenswrapper[2550]: I0603 20:02:00.833431 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-25zwz_b6b625c0-e0f2-44b3-b858-7d26d8a2746f/kube-rbac-proxy/0.log"