Jun 10 11:19:14.034588 ip-10-0-138-53 systemd[1]: Starting Kubernetes Kubelet... Jun 10 11:19:14.441817 ip-10-0-138-53 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:19:14.441817 ip-10-0-138-53 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 11:19:14.441817 ip-10-0-138-53 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:19:14.441817 ip-10-0-138-53 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 11:19:14.441817 ip-10-0-138-53 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:19:14.442658 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.442566 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 11:19:14.447601 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447579 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:19:14.447601 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447601 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447604 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447608 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447611 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447614 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447617 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447621 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447624 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447628 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447631 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447633 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447636 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447639 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447642 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447645 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447649 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447653 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447657 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447660 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:19:14.447678 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447663 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447665 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447668 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447671 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447674 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447676 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447679 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447682 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447685 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447688 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447692 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447694 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447697 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447699 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447702 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447705 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447708 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447710 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447713 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:19:14.448138 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447715 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447718 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447720 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447723 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447726 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447728 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447732 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447736 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447740 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447742 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447745 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447749 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447752 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447755 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447757 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447761 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447764 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447766 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447769 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:19:14.448860 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447771 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447774 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447777 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447781 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447783 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447786 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447789 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447791 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447794 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447798 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447800 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447803 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447806 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447808 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447811 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447813 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447816 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447818 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447821 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447824 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:19:14.449376 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447826 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447829 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447832 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447835 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447837 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447840 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447842 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447845 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447848 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447851 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447854 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447857 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447859 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447862 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447865 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447868 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447870 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447873 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447876 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447879 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:19:14.449853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.447882 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:19:14.452011 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.451992 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:19:14.452011 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452010 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452016 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452019 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452023 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452028 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452031 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452033 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452036 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452039 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452042 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452045 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452048 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452051 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452053 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452056 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452059 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452061 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452064 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452067 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452070 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:19:14.452076 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452073 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452075 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452078 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452081 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452083 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452087 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452089 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452092 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452095 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452097 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452100 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452103 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452106 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452110 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452114 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452117 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452120 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452123 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452125 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:19:14.452597 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452129 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452132 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452135 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452138 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452141 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452143 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452147 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452150 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452152 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452155 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452158 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452160 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452163 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452166 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452169 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452172 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452188 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452191 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452194 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:19:14.453147 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452197 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452199 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452202 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452205 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452208 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452211 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452213 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452216 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452219 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452221 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452224 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452226 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452229 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452232 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452234 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452237 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452239 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452242 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452244 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452247 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:19:14.453643 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452250 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452252 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452255 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452257 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452261 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452263 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452266 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452270 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452273 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452276 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452279 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452282 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452285 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452287 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452290 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452292 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452295 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452297 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452300 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452303 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:19:14.454169 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452762 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452769 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452772 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452776 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452778 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452782 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452786 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452790 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452794 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452797 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452799 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452814 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452818 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452821 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452824 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452827 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452831 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452834 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452836 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452839 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:19:14.454675 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452842 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452845 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452847 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452850 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452853 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452855 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452858 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452861 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452863 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452866 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452868 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452870 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452874 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452877 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452880 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452883 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452886 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452889 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452892 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:19:14.455231 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452895 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452897 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452900 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452903 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452905 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452908 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452910 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452913 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452916 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452919 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452922 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452924 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452927 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452930 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452933 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452936 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452938 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452940 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452943 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452946 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:19:14.455700 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452948 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452950 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452953 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452955 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452958 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452960 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452963 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452965 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452968 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452970 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452973 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452976 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452979 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452981 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452984 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452987 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452989 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452993 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452996 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.452998 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:19:14.456200 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453001 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453003 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453006 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453009 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453012 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453015 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453017 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453020 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453022 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453025 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453027 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453030 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453033 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453035 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453038 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453040 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453043 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453045 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453048 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453052 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:19:14.456691 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453119 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453126 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453132 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453137 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453141 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453145 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453150 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453155 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453158 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453162 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453165 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453169 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453172 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453188 2563 flags.go:64] FLAG: --cgroup-root="" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453191 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453194 2563 flags.go:64] FLAG: --client-ca-file="" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453198 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453201 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453207 2563 flags.go:64] FLAG: --cluster-domain="" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453220 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453223 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453227 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453230 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453234 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 11:19:14.457201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453237 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453240 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453243 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453247 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453250 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453252 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453256 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453259 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453264 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453267 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453270 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453273 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453277 2563 flags.go:64] FLAG: --enable-server="true" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453280 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453284 2563 flags.go:64] FLAG: --event-burst="100" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453287 2563 flags.go:64] FLAG: --event-qps="50" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453290 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453294 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453297 2563 flags.go:64] FLAG: --eviction-hard="" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453300 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453303 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453306 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453309 2563 flags.go:64] FLAG: --eviction-soft="" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453312 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453315 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 11:19:14.457776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453319 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453322 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453325 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453328 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453331 2563 flags.go:64] FLAG: --feature-gates="" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453335 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453338 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453341 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453344 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453347 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453350 2563 flags.go:64] FLAG: --help="false" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453353 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453356 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453359 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453362 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453365 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453368 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453371 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453377 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453380 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453383 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453386 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453390 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453393 2563 flags.go:64] FLAG: --kube-reserved="" Jun 10 11:19:14.458452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453396 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453398 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453402 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453404 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453407 2563 flags.go:64] FLAG: --lock-file="" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453411 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453414 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453417 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453423 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453426 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453429 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453432 2563 flags.go:64] FLAG: --logging-format="text" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453435 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453438 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453441 2563 flags.go:64] FLAG: --manifest-url="" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453446 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453450 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453453 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453458 2563 flags.go:64] FLAG: --max-pods="110" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453461 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453464 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453468 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453471 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453473 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453476 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 11:19:14.459055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453479 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453488 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453491 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453494 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453498 2563 flags.go:64] FLAG: --pod-cidr="" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453500 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453507 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453509 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453512 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453515 2563 flags.go:64] FLAG: --port="10250" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453518 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453522 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ea77f7da252b3bdb" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453525 2563 flags.go:64] FLAG: --qos-reserved="" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453528 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453531 2563 flags.go:64] FLAG: --register-node="true" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453534 2563 flags.go:64] FLAG: --register-with-taints="" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453537 2563 flags.go:64] FLAG: --registry-burst="10" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453541 2563 flags.go:64] FLAG: --registry-qps="5" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453544 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453547 2563 flags.go:64] FLAG: --reserved-memory="" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453556 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453559 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453563 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453566 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453569 2563 flags.go:64] FLAG: --runonce="false" Jun 10 11:19:14.459682 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453572 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453575 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453578 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453581 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453584 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453588 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453591 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453594 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453597 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453601 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453604 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453607 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453610 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453613 2563 flags.go:64] FLAG: --system-cgroups="" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453616 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453621 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453624 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453627 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453632 2563 flags.go:64] FLAG: --tls-min-version="" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453635 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453638 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453641 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453644 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453648 2563 flags.go:64] FLAG: --v="2" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453653 2563 flags.go:64] FLAG: --version="false" Jun 10 11:19:14.460310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453657 2563 flags.go:64] FLAG: --vmodule="" Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453661 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.453664 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453786 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453793 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453796 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453799 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453802 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453806 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453809 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453812 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453815 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453819 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453822 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453824 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453827 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453831 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453834 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453837 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453839 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:19:14.460951 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453842 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453845 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453847 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453850 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453853 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453856 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453858 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453861 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453863 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453866 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453870 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453874 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453878 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453882 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453885 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453888 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453892 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453895 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453897 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:19:14.461451 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453900 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453903 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453906 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453908 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453911 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453914 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453916 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453919 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453921 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453925 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453928 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453930 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453934 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453936 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453939 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453941 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453944 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453947 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453950 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453952 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:19:14.461915 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453955 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453957 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453960 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453962 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453965 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453967 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453970 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453973 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453976 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453980 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453983 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453986 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453989 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453992 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453994 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453997 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.453999 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454002 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454004 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454007 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:19:14.462428 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454009 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454013 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454016 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454018 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454021 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454024 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454026 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454029 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454031 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454034 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454036 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454039 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454042 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454044 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454047 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454050 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454052 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454054 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454057 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454059 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:19:14.462917 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454063 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454071 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.454075 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.454657 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.461598 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.461614 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.461636 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.461642 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461702 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461707 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461711 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461714 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461717 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461720 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:19:14.463433 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461723 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461726 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461729 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461732 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461735 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461737 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461740 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461743 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461745 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461748 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461751 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461753 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461756 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461758 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461761 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461764 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461767 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461770 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461772 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461775 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:19:14.463785 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461778 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461781 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461783 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461787 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461789 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461792 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461795 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461798 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461800 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461803 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461806 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461810 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461814 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461816 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461819 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461821 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461824 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461827 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461829 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461832 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:19:14.464307 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461834 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461837 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461839 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461842 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461844 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461847 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461849 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461853 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461856 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461858 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461861 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461864 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461866 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461869 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461872 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461875 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461878 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461881 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461884 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:19:14.464798 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461887 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461891 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461895 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461898 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461901 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461903 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461906 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461909 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461912 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461915 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461919 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461923 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461926 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461929 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461932 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461935 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461938 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461941 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461944 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:19:14.465286 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461947 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461950 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461952 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461955 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461958 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461960 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461963 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461965 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461968 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461971 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461974 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461977 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461980 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461983 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.461986 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:19:14.465752 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.461990 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462108 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462113 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462116 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462119 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462124 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462128 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462131 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462134 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462137 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462140 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462143 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462146 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462148 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462151 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462154 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462156 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462159 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462161 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:19:14.466159 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462164 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462167 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462169 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462172 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462191 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462195 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462197 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462200 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462203 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462206 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462209 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462212 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462215 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462217 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462220 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462223 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462225 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462228 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462231 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462233 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:19:14.466629 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462236 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462238 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462241 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462244 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462247 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462249 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462252 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462254 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462257 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462259 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462262 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462265 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462267 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462270 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462272 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462275 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462279 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462282 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462284 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:19:14.467128 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462287 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462290 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462293 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462295 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462299 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462303 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462307 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462310 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462312 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462315 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462317 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462320 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462322 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462325 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462327 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462330 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462332 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462335 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462337 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:19:14.467605 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462340 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462342 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462345 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462348 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462350 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462354 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462356 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462359 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462362 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462364 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462367 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462369 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462372 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462375 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462378 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462380 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462383 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462385 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462388 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462391 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:19:14.468074 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462394 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462396 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:14.462399 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.462404 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.462526 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.464507 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.465879 2563 server.go:1019] "Starting client certificate rotation" Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.465983 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.466023 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:19:14.468598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.468482 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:19:14.471323 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.471298 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:19:14.482784 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.482763 2563 log.go:25] "Validated CRI v1 runtime API" Jun 10 11:19:14.486944 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.486928 2563 log.go:25] "Validated CRI v1 image API" Jun 10 11:19:14.487781 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.487766 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 11:19:14.491025 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.490997 2563 fs.go:135] Filesystem UUIDs: map[2b35ecf2-0ec9-4f3c-b17c-1586d1b603ea:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a5210b43-9d7b-4e09-90d6-aa7db2d5f732:/dev/nvme0n1p4] Jun 10 11:19:14.491106 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.491024 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 11:19:14.495285 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.495103 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:19:14.497585 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.497445 2563 manager.go:216] Machine: {Timestamp:2026-06-10 11:19:14.496049431 +0000 UTC m=+0.339126337 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095681 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26b19507738cdabe2d46b3eea44c17 SystemUUID:ec26b195-0773-8cda-be2d-46b3eea44c17 BootID:e6afbc9e-ee23-4909-bf0f-f11235cec6c9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0c:61:3a:45:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0c:61:3a:45:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:b9:79:62:0a:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 11:19:14.497585 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.497582 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 11:19:14.497702 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.497673 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 11:19:14.500884 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.500854 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 11:19:14.501030 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.500887 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 11:19:14.501689 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.501678 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 11:19:14.501726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.501691 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 11:19:14.501726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.501699 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:19:14.502303 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.502291 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:19:14.503080 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.503069 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 11:19:14.505970 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.505959 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:19:14.506099 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506089 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 11:19:14.506134 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506120 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 10 11:19:14.506165 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506144 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 11:19:14.506214 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506167 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 11:19:14.506214 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506195 2563 kubelet.go:398] "Adding apiserver pod source" Jun 10 11:19:14.506214 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506207 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 11:19:14.506621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506603 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:19:14.506621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.506623 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:19:14.509003 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.508984 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 11:19:14.510684 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.510669 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 11:19:14.510726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.510720 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 11:19:14.511781 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511770 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511785 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511791 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511796 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511805 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511810 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511818 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 11:19:14.511822 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511824 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 11:19:14.512001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511830 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 11:19:14.512001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511836 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 11:19:14.512001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511845 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 11:19:14.512001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.511850 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 11:19:14.513142 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.513132 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 11:19:14.513196 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.513142 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 11:19:14.516820 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.516799 2563 server.go:1268] "Started kubelet" Jun 10 11:19:14.516903 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.516835 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 11:19:14.516952 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.516888 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 11:19:14.517010 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.516972 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 11:19:14.518461 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.518443 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 11:19:14.518764 ip-10-0-138-53 systemd[1]: Started Kubernetes Kubelet. Jun 10 11:19:14.522744 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.522705 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 11:19:14.522943 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.522918 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 11:19:14.522943 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.522920 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 11:19:14.524093 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.524074 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 10 11:19:14.524638 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.524615 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 11:19:14.525962 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.525051 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-53.ec2.internal.18b7b43da5d65287 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-53.ec2.internal,UID:ip-10-0-138-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-53.ec2.internal,},FirstTimestamp:2026-06-10 11:19:14.516611719 +0000 UTC m=+0.359688626,LastTimestamp:2026-06-10 11:19:14.516611719 +0000 UTC m=+0.359688626,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-53.ec2.internal,}" Jun 10 11:19:14.526689 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.526676 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 11:19:14.526767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.526695 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 11:19:14.526767 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.526751 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:14.527155 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527138 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 11:19:14.527256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527146 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 11:19:14.527256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527214 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 11:19:14.527367 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527325 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 10 11:19:14.527367 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527333 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 10 11:19:14.527790 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527772 2563 factory.go:55] Registering systemd factory Jun 10 11:19:14.527790 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527793 2563 factory.go:223] Registration of the systemd container factory successfully Jun 10 11:19:14.528008 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.527990 2563 factory.go:153] Registering CRI-O factory Jun 10 11:19:14.528087 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.528012 2563 factory.go:223] Registration of the crio container factory successfully Jun 10 11:19:14.528087 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.528058 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 11:19:14.528087 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.528082 2563 factory.go:103] Registering Raw factory Jun 10 11:19:14.528256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.528096 2563 manager.go:1196] Started watching for new ooms in manager Jun 10 11:19:14.528474 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.528461 2563 manager.go:349] Starting recovery of all containers Jun 10 11:19:14.535200 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.535151 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rzthm" Jun 10 11:19:14.535289 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.535245 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 11:19:14.535504 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.535480 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 11:19:14.539310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.539297 2563 manager.go:354] Recovery completed Jun 10 11:19:14.543849 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.543836 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.544403 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.544388 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rzthm" Jun 10 11:19:14.546637 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.546588 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.546713 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.546644 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.546713 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.546658 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.547433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.547311 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 11:19:14.547433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.547321 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.547433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.547322 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 11:19:14.547433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.547411 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:19:14.548170 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.548152 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.548253 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.548224 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.548253 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.548236 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.548486 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.548472 2563 policy_none.go:49] "None policy: Start" Jun 10 11:19:14.548528 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.548495 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 11:19:14.548528 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.548510 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 11:19:14.549242 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.549166 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-53.ec2.internal.18b7b43da7a040c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-53.ec2.internal,UID:ip-10-0-138-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-53.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-53.ec2.internal,},FirstTimestamp:2026-06-10 11:19:14.546622663 +0000 UTC m=+0.389699576,LastTimestamp:2026-06-10 11:19:14.546622663 +0000 UTC m=+0.389699576,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-53.ec2.internal,}" Jun 10 11:19:14.549877 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.549866 2563 policy_none.go:47] "Start" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.587629 2563 manager.go:337] "Starting Device Plugin manager" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.587661 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.587672 2563 server.go:87] "Starting device plugin registration server" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.587984 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.587998 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.588105 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.588213 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.588224 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.589102 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.589164 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.590923 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.592161 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.592225 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.592246 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.592277 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 11:19:14.594449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.593991 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:19:14.688568 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.688536 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.689976 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.689958 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.690052 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.689990 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.690052 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.690001 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.690052 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.690025 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.692513 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.692469 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal"] Jun 10 11:19:14.692559 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.692531 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.693937 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.693923 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.694011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.693949 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.694011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.693963 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.695225 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695212 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.695276 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.695312 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695294 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.695953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695938 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.695953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695947 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.696044 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695964 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.696044 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695965 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.696044 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695975 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.696044 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.695982 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.697032 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.697018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.697096 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.697040 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:19:14.697793 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.697775 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:19:14.697866 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.697802 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:19:14.697866 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.697814 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:19:14.698345 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.698320 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.698404 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.698353 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-53.ec2.internal\": node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:14.709011 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.708993 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:14.715818 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.715802 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-53.ec2.internal\" not found" node="ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.719880 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.719861 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-53.ec2.internal\" not found" node="ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.729057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.729036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6611c8dde505a3fb53f8c589ba6ee1b9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-53.ec2.internal\" (UID: \"6611c8dde505a3fb53f8c589ba6ee1b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.729131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.729066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/005e9777e0b81bfc073900f8b528bb62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal\" (UID: \"005e9777e0b81bfc073900f8b528bb62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.729131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.729083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/005e9777e0b81bfc073900f8b528bb62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal\" (UID: \"005e9777e0b81bfc073900f8b528bb62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.809389 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.809358 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:14.829644 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.829618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6611c8dde505a3fb53f8c589ba6ee1b9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-53.ec2.internal\" (UID: \"6611c8dde505a3fb53f8c589ba6ee1b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.829726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.829650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/005e9777e0b81bfc073900f8b528bb62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal\" (UID: \"005e9777e0b81bfc073900f8b528bb62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.829726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.829667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/005e9777e0b81bfc073900f8b528bb62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal\" (UID: \"005e9777e0b81bfc073900f8b528bb62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.829726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.829711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/005e9777e0b81bfc073900f8b528bb62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal\" (UID: \"005e9777e0b81bfc073900f8b528bb62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.829846 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.829724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6611c8dde505a3fb53f8c589ba6ee1b9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-53.ec2.internal\" (UID: \"6611c8dde505a3fb53f8c589ba6ee1b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.829846 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:14.829744 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/005e9777e0b81bfc073900f8b528bb62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal\" (UID: \"005e9777e0b81bfc073900f8b528bb62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:14.909824 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:14.909782 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.010712 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:15.010633 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.019802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.019780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:15.024265 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.024247 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" Jun 10 11:19:15.111198 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:15.111143 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.211698 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:15.211664 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.312235 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:15.312146 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.412830 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:15.412782 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.465308 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.465275 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 11:19:15.465949 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.465416 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:19:15.513834 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:15.513808 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-53.ec2.internal\" not found" Jun 10 11:19:15.548236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.548196 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:14:14 +0000 UTC" deadline="2028-02-11 05:24:18.436814731 +0000 UTC" Jun 10 11:19:15.548236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.548228 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14658h5m2.888589945s" Jun 10 11:19:15.596778 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.596708 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:19:15.613972 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:15.613932 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6611c8dde505a3fb53f8c589ba6ee1b9.slice/crio-ad2488f977786da64a62a76590726bc1c2b1e63f6169f45e131548263c2b6c32 WatchSource:0}: Error finding container ad2488f977786da64a62a76590726bc1c2b1e63f6169f45e131548263c2b6c32: Status 404 returned error can't find the container with id ad2488f977786da64a62a76590726bc1c2b1e63f6169f45e131548263c2b6c32 Jun 10 11:19:15.614280 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:15.614252 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005e9777e0b81bfc073900f8b528bb62.slice/crio-f7915438f4ec605ad6acb2e78dc8a04aeef3a06d27df402c7f064bb1c696cffe WatchSource:0}: Error finding container f7915438f4ec605ad6acb2e78dc8a04aeef3a06d27df402c7f064bb1c696cffe: Status 404 returned error can't find the container with id f7915438f4ec605ad6acb2e78dc8a04aeef3a06d27df402c7f064bb1c696cffe Jun 10 11:19:15.620145 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.620129 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:19:15.626947 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.626928 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" Jun 10 11:19:15.634360 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.634343 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:19:15.636725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.636709 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" Jun 10 11:19:15.651347 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.651321 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:19:15.789486 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.789454 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:19:15.962741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:15.962663 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:19:16.507161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.507128 2563 apiserver.go:52] "Watching apiserver" Jun 10 11:19:16.517695 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.517661 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 11:19:16.518858 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.518826 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hf5df","kube-system/konnectivity-agent-vpd7p","openshift-cluster-node-tuning-operator/tuned-hcn6x","openshift-dns/node-resolver-n7bh5","openshift-image-registry/node-ca-cgfzx","openshift-network-diagnostics/network-check-target-5dzcp","openshift-ovn-kubernetes/ovnkube-node-cfxlt","kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal","openshift-multus/multus-additional-cni-plugins-rjngg","openshift-multus/multus-zv5qp","openshift-multus/network-metrics-daemon-p4ktk","openshift-network-operator/iptables-alerter-4vhnk"] Jun 10 11:19:16.520729 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.520704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.521894 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.521846 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:16.522002 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.521931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:16.522986 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.522967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.523730 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.523705 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 11:19:16.523856 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.523787 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 11:19:16.523856 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.523824 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 11:19:16.524104 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.524090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.524767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.524748 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.524860 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.524775 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 11:19:16.525017 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.525001 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7kmnt\"" Jun 10 11:19:16.525090 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.525052 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.525984 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.525960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.526999 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.526976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:16.527088 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.527049 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:16.527160 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.527106 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 11:19:16.528580 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.528544 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.530399 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.530026 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.531971 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.531789 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.532840 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.532792 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.532930 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.532865 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 11:19:16.533048 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533032 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 11:19:16.533129 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533110 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hdhzr\"" Jun 10 11:19:16.533216 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.533276 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533226 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.533414 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533374 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.533491 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533475 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5gb5m\"" Jun 10 11:19:16.533548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533524 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.533660 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533640 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b4xv5\"" Jun 10 11:19:16.533722 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.533722 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rrzv\"" Jun 10 11:19:16.533821 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533808 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.533872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533825 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 11:19:16.533872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533846 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ktxcl\"" Jun 10 11:19:16.533965 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.533956 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 11:19:16.534290 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.534270 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 11:19:16.534412 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.534395 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 11:19:16.534587 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.534565 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.534796 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.534772 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.534873 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.534831 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:16.534873 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.534865 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 11:19:16.534979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.534922 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z2szx\"" Jun 10 11:19:16.535465 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.535323 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 11:19:16.536298 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.536280 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.537614 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.537567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-systemd-units\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a436461-c5b2-427f-94bc-f8b9852fd0e9-hosts-file\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-serviceca\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-system-cni-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-k8s-cni-cncf-io\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-conf-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-slash\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.539548 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-var-lib-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.539961 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-node-log\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.539961 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovn-node-metrics-cert\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.539961 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-os-release\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540100 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.539989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-cni-bin\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.540100 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:16.540100 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6kfv\" (UniqueName: \"kubernetes.io/projected/dac2d1b9-2c4a-4fa1-9879-acff77422884-kube-api-access-x6kfv\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:16.540100 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-netns\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-cni-multus\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovnkube-config\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a436461-c5b2-427f-94bc-f8b9852fd0e9-tmp-dir\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585b6939-cbca-41b6-a93f-ff51ffd39459-cni-binary-copy\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-socket-dir-parent\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-kubelet\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540684 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-etc-kubernetes\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.540684 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-etc-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.540684 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovnkube-script-lib\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.540684 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgmwm\" (UniqueName: \"kubernetes.io/projected/4a436461-c5b2-427f-94bc-f8b9852fd0e9-kube-api-access-rgmwm\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.540902 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tvt\" (UniqueName: \"kubernetes.io/projected/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-kube-api-access-t2tvt\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.540985 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f977222-de5b-495a-9c41-5ff82f5fa261-iptables-alerter-script\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.540985 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.540980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpf6d\" (UniqueName: \"kubernetes.io/projected/6a2b3e13-335f-4784-8785-1db586f6c5f1-kube-api-access-wpf6d\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.541091 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-host\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.541091 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:16.541219 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-cni-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.541219 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-cnibin\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.541219 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-cni-bin\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.541988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541475 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.541988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541634 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 11:19:16.541988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541718 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.541988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.541840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 11:19:16.542529 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542447 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qjrqr\"" Jun 10 11:19:16.542529 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-run-netns\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542750 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-systemd\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-ovn\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542807 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6wdbw\"" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f977222-de5b-495a-9c41-5ff82f5fa261-host-slash\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpjgq\" (UniqueName: \"kubernetes.io/projected/7f977222-de5b-495a-9c41-5ff82f5fa261-kube-api-access-mpjgq\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-multus-certs\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-log-socket\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.542960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543027 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-cni-netd\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-env-overrides\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.543643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-hostroot\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.543643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-daemon-config\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.543643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkvq\" (UniqueName: \"kubernetes.io/projected/585b6939-cbca-41b6-a93f-ff51ffd39459-kube-api-access-lwkvq\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.543643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.543394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-kubelet\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.575302 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.575256 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqfch" Jun 10 11:19:16.583775 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.583753 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqfch" Jun 10 11:19:16.598945 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.598869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" event={"ID":"6611c8dde505a3fb53f8c589ba6ee1b9","Type":"ContainerStarted","Data":"ad2488f977786da64a62a76590726bc1c2b1e63f6169f45e131548263c2b6c32"} Jun 10 11:19:16.600306 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.600278 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" event={"ID":"005e9777e0b81bfc073900f8b528bb62","Type":"ContainerStarted","Data":"f7915438f4ec605ad6acb2e78dc8a04aeef3a06d27df402c7f064bb1c696cffe"} Jun 10 11:19:16.628518 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.628486 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 11:19:16.644163 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-run-netns\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-ovn\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-ovn\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-run-netns\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-serviceca\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6kfv\" (UniqueName: \"kubernetes.io/projected/dac2d1b9-2c4a-4fa1-9879-acff77422884-kube-api-access-x6kfv\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-systemd\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-socket-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wmzm\" (UniqueName: \"kubernetes.io/projected/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-kube-api-access-9wmzm\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-hostroot\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-daemon-config\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-hostroot\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-kubelet\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-kubelet\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-systemd-units\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-system-cni-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-conf-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovn-node-metrics-cert\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-systemd-units\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:16.644700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-system-cni-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-conf-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-os-release\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.644799 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-modprobe-d\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644857 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-serviceca\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.644923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:17.144868617 +0000 UTC m=+2.987945511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.644983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-tuned\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645006 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-netns\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-cni-multus\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-daemon-config\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-cnibin\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-netns\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.645368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-cni-multus\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-cni-binary-copy\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/803f43d5-0da4-4c72-b16f-e1f93933e1dc-kubelet-config\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-kubelet\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-etc-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgmwm\" (UniqueName: \"kubernetes.io/projected/4a436461-c5b2-427f-94bc-f8b9852fd0e9-kube-api-access-rgmwm\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-lib-modules\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645420 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-kubelet\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-etc-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-var-lib-kubelet\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f977222-de5b-495a-9c41-5ff82f5fa261-iptables-alerter-script\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-host\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-kubernetes\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovnkube-script-lib\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-cni-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-cnibin\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-cni-bin\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-host\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-systemd\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-log-socket\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-cni-netd\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-cni-dir\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f977222-de5b-495a-9c41-5ff82f5fa261-host-slash\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpjgq\" (UniqueName: \"kubernetes.io/projected/7f977222-de5b-495a-9c41-5ff82f5fa261-kube-api-access-mpjgq\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f977222-de5b-495a-9c41-5ff82f5fa261-host-slash\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-multus-certs\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.645983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-env-overrides\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysctl-d\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-sys\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc769c60-6659-4c4d-b028-df71e55ca00d-agent-certs\") pod \"konnectivity-agent-vpd7p\" (UID: \"bc769c60-6659-4c4d-b028-df71e55ca00d\") " pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f977222-de5b-495a-9c41-5ff82f5fa261-iptables-alerter-script\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkvq\" (UniqueName: \"kubernetes.io/projected/585b6939-cbca-41b6-a93f-ff51ffd39459-kube-api-access-lwkvq\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.646994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a436461-c5b2-427f-94bc-f8b9852fd0e9-hosts-file\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysconfig\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysctl-conf\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-run\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq864\" (UniqueName: \"kubernetes.io/projected/9892fb55-c331-4f44-b74f-c79ac4b5d141-kube-api-access-wq864\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-k8s-cni-cncf-io\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-slash\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-var-lib-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-node-log\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbrwb\" (UniqueName: \"kubernetes.io/projected/80c74de4-6906-42c4-ae08-59d0d7662627-kube-api-access-lbrwb\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc769c60-6659-4c4d-b028-df71e55ca00d-konnectivity-ca\") pod \"konnectivity-agent-vpd7p\" (UID: \"bc769c60-6659-4c4d-b028-df71e55ca00d\") " pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-os-release\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-cni-bin\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-host\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646527 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovnkube-script-lib\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9892fb55-c331-4f44-b74f-c79ac4b5d141-tmp\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-env-overrides\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.647806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovnkube-config\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a436461-c5b2-427f-94bc-f8b9852fd0e9-tmp-dir\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-var-lib-cni-bin\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585b6939-cbca-41b6-a93f-ff51ffd39459-cni-binary-copy\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-socket-dir-parent\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646683 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-systemd\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-etc-kubernetes\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-log-socket\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tvt\" (UniqueName: \"kubernetes.io/projected/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-kube-api-access-t2tvt\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646769 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/803f43d5-0da4-4c72-b16f-e1f93933e1dc-dbus\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-multus-certs\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-registration-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-sys-fs\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpf6d\" (UniqueName: \"kubernetes.io/projected/6a2b3e13-335f-4784-8785-1db586f6c5f1-kube-api-access-wpf6d\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.648531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-device-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-cni-netd\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-host-run-k8s-cni-cncf-io\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-slash\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647047 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-run-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-var-lib-openvswitch\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-node-log\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647189 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-os-release\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b3e13-335f-4784-8785-1db586f6c5f1-host-cni-bin\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a436461-c5b2-427f-94bc-f8b9852fd0e9-hosts-file\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-system-cni-dir\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.646601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-cnibin\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovnkube-config\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647611 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-etc-kubernetes\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585b6939-cbca-41b6-a93f-ff51ffd39459-multus-socket-dir-parent\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585b6939-cbca-41b6-a93f-ff51ffd39459-cni-binary-copy\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.649016 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.647884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a436461-c5b2-427f-94bc-f8b9852fd0e9-tmp-dir\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.649690 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.648483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a2b3e13-335f-4784-8785-1db586f6c5f1-ovn-node-metrics-cert\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.656535 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.656500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgmwm\" (UniqueName: \"kubernetes.io/projected/4a436461-c5b2-427f-94bc-f8b9852fd0e9-kube-api-access-rgmwm\") pod \"node-resolver-n7bh5\" (UID: \"4a436461-c5b2-427f-94bc-f8b9852fd0e9\") " pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.663652 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.663594 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:16.663652 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.663622 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:16.663652 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.663635 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:16.663872 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.663721 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:19:17.163687628 +0000 UTC m=+3.006764542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:16.665710 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.665686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkvq\" (UniqueName: \"kubernetes.io/projected/585b6939-cbca-41b6-a93f-ff51ffd39459-kube-api-access-lwkvq\") pod \"multus-zv5qp\" (UID: \"585b6939-cbca-41b6-a93f-ff51ffd39459\") " pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.666327 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.666284 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpjgq\" (UniqueName: \"kubernetes.io/projected/7f977222-de5b-495a-9c41-5ff82f5fa261-kube-api-access-mpjgq\") pod \"iptables-alerter-4vhnk\" (UID: \"7f977222-de5b-495a-9c41-5ff82f5fa261\") " pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.666767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.666725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpf6d\" (UniqueName: \"kubernetes.io/projected/6a2b3e13-335f-4784-8785-1db586f6c5f1-kube-api-access-wpf6d\") pod \"ovnkube-node-cfxlt\" (UID: \"6a2b3e13-335f-4784-8785-1db586f6c5f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.667420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.667400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tvt\" (UniqueName: \"kubernetes.io/projected/2450c6e8-d08e-4be1-abd8-5b04aa85f34f-kube-api-access-t2tvt\") pod \"node-ca-cgfzx\" (UID: \"2450c6e8-d08e-4be1-abd8-5b04aa85f34f\") " pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.667947 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.667927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6kfv\" (UniqueName: \"kubernetes.io/projected/dac2d1b9-2c4a-4fa1-9879-acff77422884-kube-api-access-x6kfv\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:16.716165 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.716132 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:19:16.748780 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.748723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbrwb\" (UniqueName: \"kubernetes.io/projected/80c74de4-6906-42c4-ae08-59d0d7662627-kube-api-access-lbrwb\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.748954 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.748877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc769c60-6659-4c4d-b028-df71e55ca00d-konnectivity-ca\") pod \"konnectivity-agent-vpd7p\" (UID: \"bc769c60-6659-4c4d-b028-df71e55ca00d\") " pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.748954 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.748938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-host\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.748961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9892fb55-c331-4f44-b74f-c79ac4b5d141-tmp\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.748992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/803f43d5-0da4-4c72-b16f-e1f93933e1dc-dbus\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.749084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-registration-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-host\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-registration-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-sys-fs\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-sys-fs\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/803f43d5-0da4-4c72-b16f-e1f93933e1dc-dbus\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-device-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-device-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-system-cni-dir\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-systemd\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-socket-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-system-cni-dir\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzm\" (UniqueName: \"kubernetes.io/projected/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-kube-api-access-9wmzm\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-systemd\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-socket-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-os-release\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-modprobe-d\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-os-release\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-tuned\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc769c60-6659-4c4d-b028-df71e55ca00d-konnectivity-ca\") pod \"konnectivity-agent-vpd7p\" (UID: \"bc769c60-6659-4c4d-b028-df71e55ca00d\") " pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-etc-selinux\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.749751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749615 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-modprobe-d\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-cnibin\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-cni-binary-copy\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c74de4-6906-42c4-ae08-59d0d7662627-cnibin\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.749690 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:16.749748 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:19:17.249730472 +0000 UTC m=+3.092807376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/803f43d5-0da4-4c72-b16f-e1f93933e1dc-kubelet-config\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-lib-modules\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-var-lib-kubelet\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-kubernetes\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-kubernetes\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-lib-modules\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/803f43d5-0da4-4c72-b16f-e1f93933e1dc-kubelet-config\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749992 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-var-lib-kubelet\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.750563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.749995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysctl-d\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-sys\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc769c60-6659-4c4d-b028-df71e55ca00d-agent-certs\") pod \"konnectivity-agent-vpd7p\" (UID: \"bc769c60-6659-4c4d-b028-df71e55ca00d\") " pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysctl-d\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysconfig\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-cni-binary-copy\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-sys\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysctl-conf\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-run\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq864\" (UniqueName: \"kubernetes.io/projected/9892fb55-c331-4f44-b74f-c79ac4b5d141-kube-api-access-wq864\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-run\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750160 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysconfig\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-sysctl-conf\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.751420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.750267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c74de4-6906-42c4-ae08-59d0d7662627-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.752099 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.752021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9892fb55-c331-4f44-b74f-c79ac4b5d141-tmp\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.752099 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.752068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9892fb55-c331-4f44-b74f-c79ac4b5d141-etc-tuned\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.752633 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.752599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc769c60-6659-4c4d-b028-df71e55ca00d-agent-certs\") pod \"konnectivity-agent-vpd7p\" (UID: \"bc769c60-6659-4c4d-b028-df71e55ca00d\") " pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.760042 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.760016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbrwb\" (UniqueName: \"kubernetes.io/projected/80c74de4-6906-42c4-ae08-59d0d7662627-kube-api-access-lbrwb\") pod \"multus-additional-cni-plugins-rjngg\" (UID: \"80c74de4-6906-42c4-ae08-59d0d7662627\") " pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.760944 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.760918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq864\" (UniqueName: \"kubernetes.io/projected/9892fb55-c331-4f44-b74f-c79ac4b5d141-kube-api-access-wq864\") pod \"tuned-hcn6x\" (UID: \"9892fb55-c331-4f44-b74f-c79ac4b5d141\") " pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:16.761325 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.761306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wmzm\" (UniqueName: \"kubernetes.io/projected/5bb29b60-9b2d-44b2-80fd-1fb1a37716c2-kube-api-access-9wmzm\") pod \"aws-ebs-csi-driver-node-qlxpg\" (UID: \"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.835351 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.835323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:16.844662 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.844632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vhnk" Jun 10 11:19:16.855424 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.855387 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n7bh5" Jun 10 11:19:16.859962 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.859930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cgfzx" Jun 10 11:19:16.868517 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.868497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zv5qp" Jun 10 11:19:16.876074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.876052 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rjngg" Jun 10 11:19:16.884742 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.884723 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:16.891278 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.891262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" Jun 10 11:19:16.897855 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:16.897836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" Jun 10 11:19:17.152923 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.152846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:17.153084 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.152989 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:17.153084 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.153062 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.153042748 +0000 UTC m=+3.996119668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:17.253606 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.253574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:17.253798 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.253631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:17.253798 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.253736 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:17.253798 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.253753 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:17.253798 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.253771 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:17.253798 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.253780 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:17.253975 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.253805 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.253786429 +0000 UTC m=+4.096863323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:17.253975 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:17.253825 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:19:18.253818199 +0000 UTC m=+4.096895094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:17.462023 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.461986 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc769c60_6659_4c4d_b028_df71e55ca00d.slice/crio-83305e42c2fc0e13a4256748f0f2ea4923610cbfed44cb25af0344b3ebd09503 WatchSource:0}: Error finding container 83305e42c2fc0e13a4256748f0f2ea4923610cbfed44cb25af0344b3ebd09503: Status 404 returned error can't find the container with id 83305e42c2fc0e13a4256748f0f2ea4923610cbfed44cb25af0344b3ebd09503 Jun 10 11:19:17.462564 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.462487 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585b6939_cbca_41b6_a93f_ff51ffd39459.slice/crio-7af14c601b3aa7397e13647fce7c89f4ee231d6363c9ab1c177b22dc87ba421b WatchSource:0}: Error finding container 7af14c601b3aa7397e13647fce7c89f4ee231d6363c9ab1c177b22dc87ba421b: Status 404 returned error can't find the container with id 7af14c601b3aa7397e13647fce7c89f4ee231d6363c9ab1c177b22dc87ba421b Jun 10 11:19:17.464088 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.464070 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c74de4_6906_42c4_ae08_59d0d7662627.slice/crio-f12b654b741fafbeaacff12fe800d5e21bd9cd59c904ffc136b4b2250e17b1d9 WatchSource:0}: Error finding container f12b654b741fafbeaacff12fe800d5e21bd9cd59c904ffc136b4b2250e17b1d9: Status 404 returned error can't find the container with id f12b654b741fafbeaacff12fe800d5e21bd9cd59c904ffc136b4b2250e17b1d9 Jun 10 11:19:17.468891 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.468868 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f977222_de5b_495a_9c41_5ff82f5fa261.slice/crio-1039b82c75aee5752e4ff4ae27423494b88368fb746fc163137a5f0c403959e6 WatchSource:0}: Error finding container 1039b82c75aee5752e4ff4ae27423494b88368fb746fc163137a5f0c403959e6: Status 404 returned error can't find the container with id 1039b82c75aee5752e4ff4ae27423494b88368fb746fc163137a5f0c403959e6 Jun 10 11:19:17.469923 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.469859 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2b3e13_335f_4784_8785_1db586f6c5f1.slice/crio-aec8e1bff72f3b37e21f1ae451b37545fd30634186661b2ab1889c194feebeff WatchSource:0}: Error finding container aec8e1bff72f3b37e21f1ae451b37545fd30634186661b2ab1889c194feebeff: Status 404 returned error can't find the container with id aec8e1bff72f3b37e21f1ae451b37545fd30634186661b2ab1889c194feebeff Jun 10 11:19:17.472703 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.472347 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9892fb55_c331_4f44_b74f_c79ac4b5d141.slice/crio-66a835d789f98a98a7c52a55c5d3c03fb3da11e0ab9637c8fed6e20d4a729336 WatchSource:0}: Error finding container 66a835d789f98a98a7c52a55c5d3c03fb3da11e0ab9637c8fed6e20d4a729336: Status 404 returned error can't find the container with id 66a835d789f98a98a7c52a55c5d3c03fb3da11e0ab9637c8fed6e20d4a729336 Jun 10 11:19:17.475277 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.475199 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb29b60_9b2d_44b2_80fd_1fb1a37716c2.slice/crio-f56c9d62e2272da171b7abb180ad8f924aae488b484cd37af0bfd8d9e54c3523 WatchSource:0}: Error finding container f56c9d62e2272da171b7abb180ad8f924aae488b484cd37af0bfd8d9e54c3523: Status 404 returned error can't find the container with id f56c9d62e2272da171b7abb180ad8f924aae488b484cd37af0bfd8d9e54c3523 Jun 10 11:19:17.475561 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.475409 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a436461_c5b2_427f_94bc_f8b9852fd0e9.slice/crio-1f01ead236957965966b22beada1fd21ed8f4e4ed1c2c2603b99ab14dc595f00 WatchSource:0}: Error finding container 1f01ead236957965966b22beada1fd21ed8f4e4ed1c2c2603b99ab14dc595f00: Status 404 returned error can't find the container with id 1f01ead236957965966b22beada1fd21ed8f4e4ed1c2c2603b99ab14dc595f00 Jun 10 11:19:17.475692 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:17.475618 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2450c6e8_d08e_4be1_abd8_5b04aa85f34f.slice/crio-20d623b108afa0d2ea85bd32d8151fdbe7a525caf6fd3f9d7dbcc79d90f3298e WatchSource:0}: Error finding container 20d623b108afa0d2ea85bd32d8151fdbe7a525caf6fd3f9d7dbcc79d90f3298e: Status 404 returned error can't find the container with id 20d623b108afa0d2ea85bd32d8151fdbe7a525caf6fd3f9d7dbcc79d90f3298e Jun 10 11:19:17.586148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.586107 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:14:16 +0000 UTC" deadline="2028-01-23 04:16:21.125618274 +0000 UTC" Jun 10 11:19:17.586148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.586140 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14200h57m3.539481241s" Jun 10 11:19:17.605069 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.605037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" event={"ID":"6611c8dde505a3fb53f8c589ba6ee1b9","Type":"ContainerStarted","Data":"829b109bd8424d2334d2f793c65063fd1995eb5c538dfb6391aed60a8de622f3"} Jun 10 11:19:17.606757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.606729 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cgfzx" event={"ID":"2450c6e8-d08e-4be1-abd8-5b04aa85f34f","Type":"ContainerStarted","Data":"20d623b108afa0d2ea85bd32d8151fdbe7a525caf6fd3f9d7dbcc79d90f3298e"} Jun 10 11:19:17.611643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.609162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" event={"ID":"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2","Type":"ContainerStarted","Data":"f56c9d62e2272da171b7abb180ad8f924aae488b484cd37af0bfd8d9e54c3523"} Jun 10 11:19:17.613280 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.613251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" event={"ID":"9892fb55-c331-4f44-b74f-c79ac4b5d141","Type":"ContainerStarted","Data":"66a835d789f98a98a7c52a55c5d3c03fb3da11e0ab9637c8fed6e20d4a729336"} Jun 10 11:19:17.616798 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.616759 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerStarted","Data":"f12b654b741fafbeaacff12fe800d5e21bd9cd59c904ffc136b4b2250e17b1d9"} Jun 10 11:19:17.618772 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.618748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vpd7p" event={"ID":"bc769c60-6659-4c4d-b028-df71e55ca00d","Type":"ContainerStarted","Data":"83305e42c2fc0e13a4256748f0f2ea4923610cbfed44cb25af0344b3ebd09503"} Jun 10 11:19:17.620590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.620562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n7bh5" event={"ID":"4a436461-c5b2-427f-94bc-f8b9852fd0e9","Type":"ContainerStarted","Data":"1f01ead236957965966b22beada1fd21ed8f4e4ed1c2c2603b99ab14dc595f00"} Jun 10 11:19:17.621665 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.621645 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"aec8e1bff72f3b37e21f1ae451b37545fd30634186661b2ab1889c194feebeff"} Jun 10 11:19:17.622602 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.622546 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-53.ec2.internal" podStartSLOduration=2.622531688 podStartE2EDuration="2.622531688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:17.62222845 +0000 UTC m=+3.465305366" watchObservedRunningTime="2026-06-10 11:19:17.622531688 +0000 UTC m=+3.465608606" Jun 10 11:19:17.623014 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.622992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vhnk" event={"ID":"7f977222-de5b-495a-9c41-5ff82f5fa261","Type":"ContainerStarted","Data":"1039b82c75aee5752e4ff4ae27423494b88368fb746fc163137a5f0c403959e6"} Jun 10 11:19:17.624098 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:17.624077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zv5qp" event={"ID":"585b6939-cbca-41b6-a93f-ff51ffd39459","Type":"ContainerStarted","Data":"7af14c601b3aa7397e13647fce7c89f4ee231d6363c9ab1c177b22dc87ba421b"} Jun 10 11:19:18.159802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.159519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:18.159802 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.159735 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:18.159802 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.159799 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:20.159780762 +0000 UTC m=+6.002857656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:18.260596 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.260560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:18.260775 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.260626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:18.260775 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.260735 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:18.260876 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.260794 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:19:20.260776807 +0000 UTC m=+6.103853715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:18.261237 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.261211 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:18.261237 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.261237 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:18.261434 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.261251 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:18.261434 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.261298 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:19:20.261283213 +0000 UTC m=+6.104360123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:18.586620 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.586510 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:14:16 +0000 UTC" deadline="2027-12-17 14:06:48.089032597 +0000 UTC" Jun 10 11:19:18.586620 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.586572 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13322h47m29.502464435s" Jun 10 11:19:18.595323 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.595293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:18.595462 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.595428 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:18.595883 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.595865 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:18.596015 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.595995 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:18.596372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.596355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:18.596501 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:18.596457 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:18.639067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.637818 2563 generic.go:356] "Generic (PLEG): container finished" podID="005e9777e0b81bfc073900f8b528bb62" containerID="8b5f67962e266d09083442e5f3a6940b3bd74e5b5a37d60bad020926a94cbf38" exitCode=0 Jun 10 11:19:18.639067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:18.638812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" event={"ID":"005e9777e0b81bfc073900f8b528bb62","Type":"ContainerDied","Data":"8b5f67962e266d09083442e5f3a6940b3bd74e5b5a37d60bad020926a94cbf38"} Jun 10 11:19:19.663673 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:19.663635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" event={"ID":"005e9777e0b81bfc073900f8b528bb62","Type":"ContainerStarted","Data":"fc6e70391a77f7b3b4a6a62a51f962e5e19242387cd195e11717ae33d4d8e192"} Jun 10 11:19:20.183209 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:20.183157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:20.183383 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.183332 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:20.183935 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.183495 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:24.18342253 +0000 UTC m=+10.026499427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:20.283769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:20.283851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.284089 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.284113 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.284127 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.284203 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:19:24.284170417 +0000 UTC m=+10.127247329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.284664 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:20.284751 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.284718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:19:24.284702305 +0000 UTC m=+10.127779216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:20.594338 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:20.594266 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:20.594483 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.594383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:20.594741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:20.594722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:20.594851 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.594824 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:20.594938 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:20.594871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:20.595006 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:20.594941 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:22.593146 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:22.593109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:22.593503 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:22.593267 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:22.593927 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:22.593690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:22.593927 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:22.593804 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:22.594067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:22.593958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:22.594067 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:22.594046 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:24.217939 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:24.217858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:24.218450 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.218003 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:24.218450 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.218081 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:32.218058669 +0000 UTC m=+18.061135575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:24.318867 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:24.318826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:24.319031 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:24.318906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:24.319031 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.318984 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:24.319031 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.319010 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:24.319031 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.319024 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:24.319031 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.319027 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:24.319245 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.319080 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:19:32.319064242 +0000 UTC m=+18.162141154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:24.319245 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.319100 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:19:32.319090594 +0000 UTC m=+18.162167492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:24.594868 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:24.594252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:24.594868 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.594387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:24.594868 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:24.594768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:24.595141 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.594885 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:24.595141 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:24.594937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:24.595141 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:24.595007 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:26.592859 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:26.592821 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:26.593470 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:26.592958 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:26.593470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:26.592986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:26.593470 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:26.593105 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:26.593470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:26.593173 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:26.593470 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:26.593259 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:28.592865 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:28.592828 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:28.593382 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:28.592872 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:28.593382 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:28.592975 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:28.593382 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:28.593066 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:28.593382 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:28.593099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:28.593382 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:28.593201 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:30.593209 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:30.593161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:30.593678 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:30.593161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:30.593678 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:30.593327 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:30.593678 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:30.593157 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:30.593678 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:30.593398 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:30.593678 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:30.593503 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:32.283697 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:32.283657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:32.284166 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.283824 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:32.284166 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.283903 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:19:48.283880832 +0000 UTC m=+34.126957733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:32.384828 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:32.384797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:32.385028 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:32.384846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:32.385028 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.384939 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:32.385028 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.384961 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:32.385028 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.384992 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:32.385028 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.385003 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:32.385028 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.385008 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:19:48.384988953 +0000 UTC m=+34.228065868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:32.385358 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.385047 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:19:48.385030465 +0000 UTC m=+34.228107373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:32.593560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:32.593474 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:32.593560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:32.593505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:32.593560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:32.593474 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:32.593807 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.593607 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:32.593807 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.593694 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:32.593807 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:32.593739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:34.594128 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:34.593925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:34.594588 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:34.593948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:34.594588 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:34.594229 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:34.594588 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:34.593973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:34.594588 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:34.594316 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:34.594588 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:34.594350 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:36.593286 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.593257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:36.594213 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.593367 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:36.594213 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:36.593373 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:36.594213 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.593395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:36.594213 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:36.593482 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:36.594213 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:36.593554 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:36.698951 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.698917 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cgfzx" event={"ID":"2450c6e8-d08e-4be1-abd8-5b04aa85f34f","Type":"ContainerStarted","Data":"fc37656055dc3eca949fe2c90977da2dd71ef94e9ee1a5ae0de43c88c5a0b082"} Jun 10 11:19:36.700376 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.700347 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" event={"ID":"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2","Type":"ContainerStarted","Data":"bf52dfb2bc05f7e430129f59cea9d0a33a137a870e1c5dcc26118c9c2f05a09f"} Jun 10 11:19:36.701671 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.701646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" event={"ID":"9892fb55-c331-4f44-b74f-c79ac4b5d141","Type":"ContainerStarted","Data":"1f9c523736dfc65740bc7b16b8185fca0c17f5eb3e15e60027b1a4b6bd1ce45b"} Jun 10 11:19:36.703347 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.703324 2563 generic.go:356] "Generic (PLEG): container finished" podID="80c74de4-6906-42c4-ae08-59d0d7662627" containerID="f6bf7390b4f13fc710c05a25117ad7f8212a211c2d9e2396d60b0bb06d32105a" exitCode=0 Jun 10 11:19:36.703427 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.703402 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerDied","Data":"f6bf7390b4f13fc710c05a25117ad7f8212a211c2d9e2396d60b0bb06d32105a"} Jun 10 11:19:36.704934 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.704901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vpd7p" event={"ID":"bc769c60-6659-4c4d-b028-df71e55ca00d","Type":"ContainerStarted","Data":"c1151e386d8a635eba40953c511f547aa096749fdffc5bd772360e1f4475196c"} Jun 10 11:19:36.706608 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.706582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n7bh5" event={"ID":"4a436461-c5b2-427f-94bc-f8b9852fd0e9","Type":"ContainerStarted","Data":"24e0b3bf6239d9a511673c2b645462e94d9a5a92239c0923830e541edd1134e9"} Jun 10 11:19:36.708147 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.708130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:19:36.708556 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.708527 2563 generic.go:356] "Generic (PLEG): container finished" podID="6a2b3e13-335f-4784-8785-1db586f6c5f1" containerID="67b3d8147447d7ff1f858b897362b64e4a35fcd6df4514f4dbc3faff8d685e00" exitCode=1 Jun 10 11:19:36.708624 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.708586 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerDied","Data":"67b3d8147447d7ff1f858b897362b64e4a35fcd6df4514f4dbc3faff8d685e00"} Jun 10 11:19:36.708668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.708651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"fed44b6c77a00b63e4207fe3997b92d4a316647f2f79058673513141b4064346"} Jun 10 11:19:36.709849 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.709828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zv5qp" event={"ID":"585b6939-cbca-41b6-a93f-ff51ffd39459","Type":"ContainerStarted","Data":"05e4520fd5116ea59b9559156d129312e3c78a8ecee6e9d7a0aef086b87b90d1"} Jun 10 11:19:36.724919 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.724568 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-53.ec2.internal" podStartSLOduration=21.724547226 podStartE2EDuration="21.724547226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:19.684798331 +0000 UTC m=+5.527875247" watchObservedRunningTime="2026-06-10 11:19:36.724547226 +0000 UTC m=+22.567624143" Jun 10 11:19:36.725193 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.725133 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cgfzx" podStartSLOduration=4.140581166 podStartE2EDuration="22.725121408s" totalImagesPullingTime="18.584540242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:36.724964935 +0000 UTC m=+22.568041852" watchObservedRunningTime="2026-06-10 11:19:36.725121408 +0000 UTC m=+22.568198329" Jun 10 11:19:36.745685 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.745639 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hcn6x" podStartSLOduration=3.157002416 podStartE2EDuration="21.745623739s" totalImagesPullingTime="18.588621323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:36.745383539 +0000 UTC m=+22.588460455" watchObservedRunningTime="2026-06-10 11:19:36.745623739 +0000 UTC m=+22.588700655" Jun 10 11:19:36.764272 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.764228 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n7bh5" podStartSLOduration=4.179181409 podStartE2EDuration="22.764213273s" totalImagesPullingTime="18.585031864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:36.763407661 +0000 UTC m=+22.606484577" watchObservedRunningTime="2026-06-10 11:19:36.764213273 +0000 UTC m=+22.607290189" Jun 10 11:19:36.787425 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.787371 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zv5qp" podStartSLOduration=4.147934544 podStartE2EDuration="22.787351836s" totalImagesPullingTime="18.639417292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:36.787270154 +0000 UTC m=+22.630347071" watchObservedRunningTime="2026-06-10 11:19:36.787351836 +0000 UTC m=+22.630428753" Jun 10 11:19:36.845838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:36.845795 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vpd7p" podStartSLOduration=4.2814847799999995 podStartE2EDuration="22.845781045s" totalImagesPullingTime="18.564296265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:36.844033091 +0000 UTC m=+22.687110017" watchObservedRunningTime="2026-06-10 11:19:36.845781045 +0000 UTC m=+22.688858012" Jun 10 11:19:37.715082 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.715050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:19:37.715539 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.715473 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"77df88601d5365e31074268fb56bcc918894c105403fa10c1b36057dd40dfbfc"} Jun 10 11:19:37.715610 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.715598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"4d0dde3239b04469ae9b8b87d229e5d8c88adc94ab9e3e90fa498a0012270ecb"} Jun 10 11:19:37.715672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.715642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"1f1a6b470dcfc6963737873e8f2273d76c7ec30e245f9c3de44f3516781e27e7"} Jun 10 11:19:37.715672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.715671 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"4c05918e8bfffb28eb6d2b229310b92756143b08a4781f4db8acba75407ecb85"} Jun 10 11:19:37.717105 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.717056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vhnk" event={"ID":"7f977222-de5b-495a-9c41-5ff82f5fa261","Type":"ContainerStarted","Data":"9a6aa8dd0268e394ee7bd431a98e6cd3634cc527639cd6ef3526f7b66506ebb7"} Jun 10 11:19:37.735885 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.735843 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vhnk" podStartSLOduration=5.143784732 podStartE2EDuration="23.735827828s" totalImagesPullingTime="18.592043096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:37.735096859 +0000 UTC m=+23.578173773" watchObservedRunningTime="2026-06-10 11:19:37.735827828 +0000 UTC m=+23.578904744" Jun 10 11:19:37.749571 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:37.749535 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 11:19:38.593425 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.593389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:38.593622 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.593427 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:38.593622 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.593392 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:38.593622 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:38.593525 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:38.593777 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:38.593668 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:38.593777 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:38.593764 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:38.604622 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.604526 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T11:19:37.749556503Z","UUID":"94333e09-897b-4d8b-a9f9-e4dce03532c3","Handler":null,"Name":"","Endpoint":""} Jun 10 11:19:38.606139 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.606106 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 11:19:38.606271 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.606151 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 11:19:38.723521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:38.722660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" event={"ID":"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2","Type":"ContainerStarted","Data":"88515970b0d3434e63a225e4f195a41b5259b74a1bc0b2877aa03727bbca4477"} Jun 10 11:19:39.401383 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:39.401348 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:39.402071 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:39.402049 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:39.727433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:39.727348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" event={"ID":"5bb29b60-9b2d-44b2-80fd-1fb1a37716c2","Type":"ContainerStarted","Data":"18fb40a162b8730f0548b98436f8d8408d7eb74669609b3fb793dada95c0c9fd"} Jun 10 11:19:39.727965 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:39.727598 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:39.728170 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:39.728153 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vpd7p" Jun 10 11:19:39.747857 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:39.747802 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlxpg" podStartSLOduration=4.174920325 podStartE2EDuration="24.747781076s" totalImagesPullingTime="20.572860751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:39.747425082 +0000 UTC m=+25.590501990" watchObservedRunningTime="2026-06-10 11:19:39.747781076 +0000 UTC m=+25.590857995" Jun 10 11:19:40.593594 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:40.593560 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:40.593594 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:40.593585 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:40.593838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:40.593568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:40.593838 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:40.593691 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:40.593838 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:40.593749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:40.593992 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:40.593862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:41.734133 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:41.734106 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:19:41.734749 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:41.734479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"49970d1b8c351fdc9b372ed9d2e093802b838dc48cc48836ec88468dd7e30177"} Jun 10 11:19:41.736109 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:41.736085 2563 generic.go:356] "Generic (PLEG): container finished" podID="80c74de4-6906-42c4-ae08-59d0d7662627" containerID="c70b0c7270ba07a775ac2266f6447a5e9230ad298bbe9907f7be641879733862" exitCode=0 Jun 10 11:19:41.736219 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:41.736167 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerDied","Data":"c70b0c7270ba07a775ac2266f6447a5e9230ad298bbe9907f7be641879733862"} Jun 10 11:19:42.592526 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:42.592489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:42.592689 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:42.592538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:42.592689 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:42.592490 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:42.592689 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:42.592603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:42.592803 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:42.592698 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:42.592803 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:42.592784 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:43.743254 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.743048 2563 generic.go:356] "Generic (PLEG): container finished" podID="80c74de4-6906-42c4-ae08-59d0d7662627" containerID="70f25539597764fc2d5d45ef0bb144e2f017249399b1a858842d6917cda77167" exitCode=0 Jun 10 11:19:43.743740 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.743131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerDied","Data":"70f25539597764fc2d5d45ef0bb144e2f017249399b1a858842d6917cda77167"} Jun 10 11:19:43.746626 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.746611 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:19:43.746951 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.746930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"cb1f5615818b090ca0d797609cf374f072505991a4d249a612633802ef88c31d"} Jun 10 11:19:43.747173 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.747159 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:43.747438 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.747422 2563 scope.go:117] "RemoveContainer" containerID="67b3d8147447d7ff1f858b897362b64e4a35fcd6df4514f4dbc3faff8d685e00" Jun 10 11:19:43.764062 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:43.764038 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:44.593449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.593417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:44.593621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.593523 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:44.593621 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:44.593519 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:44.593621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.593544 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:44.593780 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:44.593626 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:44.593780 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:44.593718 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:44.751993 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.751970 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:19:44.752359 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.752315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" event={"ID":"6a2b3e13-335f-4784-8785-1db586f6c5f1","Type":"ContainerStarted","Data":"db647f0db3efafda2c9cb2e68ec38ff444dcd4ff32dac8b4d5d01d695d9b44cc"} Jun 10 11:19:44.757923 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.757905 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:44.758065 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.758040 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:44.776072 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.776047 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:19:44.796317 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:44.796254 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" podStartSLOduration=11.892000569 podStartE2EDuration="30.796234312s" totalImagesPullingTime="18.904233743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:44.794574242 +0000 UTC m=+30.637651170" watchObservedRunningTime="2026-06-10 11:19:44.796234312 +0000 UTC m=+30.639311230" Jun 10 11:19:45.756661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:45.756486 2563 generic.go:356] "Generic (PLEG): container finished" podID="80c74de4-6906-42c4-ae08-59d0d7662627" containerID="20a54339eea0ca2342b193e2055be33cb0b7f73c15f158951b5e6b5ae249bf21" exitCode=0 Jun 10 11:19:45.757006 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:45.756573 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerDied","Data":"20a54339eea0ca2342b193e2055be33cb0b7f73c15f158951b5e6b5ae249bf21"} Jun 10 11:19:46.592568 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:46.592506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:46.592746 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:46.592506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:46.592746 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:46.592630 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:46.592746 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:46.592642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:46.592913 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:46.592761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:46.592913 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:46.592836 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:48.305423 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:48.305383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:48.306007 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.305552 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:48.306007 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.305638 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs podName:dac2d1b9-2c4a-4fa1-9879-acff77422884 nodeName:}" failed. No retries permitted until 2026-06-10 11:20:20.305615507 +0000 UTC m=+66.148692426 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs") pod "network-metrics-daemon-p4ktk" (UID: "dac2d1b9-2c4a-4fa1-9879-acff77422884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:19:48.406484 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:48.406447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:48.406484 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:48.406499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:48.406736 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.406633 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:48.406736 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.406663 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:19:48.406736 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.406693 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:19:48.406736 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.406705 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret podName:803f43d5-0da4-4c72-b16f-e1f93933e1dc nodeName:}" failed. No retries permitted until 2026-06-10 11:20:20.40668681 +0000 UTC m=+66.249763708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret") pod "global-pull-secret-syncer-hf5df" (UID: "803f43d5-0da4-4c72-b16f-e1f93933e1dc") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:19:48.406736 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.406710 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6w5hl for pod openshift-network-diagnostics/network-check-target-5dzcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:48.407001 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.406761 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl podName:779be0f7-8538-43ee-b819-8132f63fdbfe nodeName:}" failed. No retries permitted until 2026-06-10 11:20:20.406749156 +0000 UTC m=+66.249826062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6w5hl" (UniqueName: "kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl") pod "network-check-target-5dzcp" (UID: "779be0f7-8538-43ee-b819-8132f63fdbfe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:19:48.593317 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:48.593168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:48.593317 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:48.593207 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:48.593317 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:48.593195 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:48.593573 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.593322 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:48.593573 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.593393 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:48.593573 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:48.593467 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:50.162155 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.162118 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5dzcp"] Jun 10 11:19:50.162841 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.162237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:50.162841 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:50.162319 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:50.164820 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.164797 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hf5df"] Jun 10 11:19:50.164937 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.164887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:50.165018 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:50.164987 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:50.165456 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.165434 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4ktk"] Jun 10 11:19:50.165606 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.165524 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:50.165670 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:50.165618 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:50.772282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.771787 2563 generic.go:356] "Generic (PLEG): container finished" podID="80c74de4-6906-42c4-ae08-59d0d7662627" containerID="95481dd4ac4210c2e5350d4b19de5c6029353749f76b8cc17ff58f08efad217e" exitCode=0 Jun 10 11:19:50.772282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:50.771859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerDied","Data":"95481dd4ac4210c2e5350d4b19de5c6029353749f76b8cc17ff58f08efad217e"} Jun 10 11:19:51.592944 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:51.592764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:51.593326 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:51.592821 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:51.593326 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:51.593016 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:51.593326 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:51.592822 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:51.593326 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:51.593093 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:51.593326 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:51.593193 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:51.777118 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:51.777085 2563 generic.go:356] "Generic (PLEG): container finished" podID="80c74de4-6906-42c4-ae08-59d0d7662627" containerID="f3f50b8446d282eb0e0357711e4b7daa3549613db8540285ea06091d05036250" exitCode=0 Jun 10 11:19:51.777297 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:51.777139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerDied","Data":"f3f50b8446d282eb0e0357711e4b7daa3549613db8540285ea06091d05036250"} Jun 10 11:19:52.783012 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:52.782980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjngg" event={"ID":"80c74de4-6906-42c4-ae08-59d0d7662627","Type":"ContainerStarted","Data":"a03c6b3c976fdfe8a860657434772000d60a5eeda84ac8bdd57ac13048537c1b"} Jun 10 11:19:52.812483 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:52.812429 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rjngg" podStartSLOduration=14.131567197 podStartE2EDuration="38.812410927s" totalImagesPullingTime="24.68084373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:52.811818783 +0000 UTC m=+38.654895722" watchObservedRunningTime="2026-06-10 11:19:52.812410927 +0000 UTC m=+38.655487842" Jun 10 11:19:53.593238 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:53.593199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:53.593238 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:53.593237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:53.593543 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:53.593199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:53.593543 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:53.593312 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4ktk" podUID="dac2d1b9-2c4a-4fa1-9879-acff77422884" Jun 10 11:19:53.593543 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:53.593417 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf5df" podUID="803f43d5-0da4-4c72-b16f-e1f93933e1dc" Jun 10 11:19:53.593543 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:19:53.593488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dzcp" podUID="779be0f7-8538-43ee-b819-8132f63fdbfe" Jun 10 11:19:54.937962 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:54.937937 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-53.ec2.internal" event="NodeReady" Jun 10 11:19:54.938328 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:54.938063 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 11:19:54.997014 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:54.996976 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sk5hx"] Jun 10 11:19:54.998829 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:54.998813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.000668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.000637 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ljsmw"] Jun 10 11:19:55.001473 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.001451 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 11:19:55.001602 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.001584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 11:19:55.001661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.001653 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h5jpn\"" Jun 10 11:19:55.001883 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.001870 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 11:19:55.002412 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.002394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.002883 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.002871 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 11:19:55.005587 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.005566 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 11:19:55.005706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.005688 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 11:19:55.006714 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.006429 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lr4d\"" Jun 10 11:19:55.020024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.019998 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ljsmw"] Jun 10 11:19:55.020725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.020700 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sk5hx"] Jun 10 11:19:55.101878 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.101846 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k55sv"] Jun 10 11:19:55.103590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.103570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.106446 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.106420 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 11:19:55.106587 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.106473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 11:19:55.107230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.107201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 11:19:55.110083 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.107514 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zz7w7\"" Jun 10 11:19:55.114625 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.114599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k55sv"] Jun 10 11:19:55.153835 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5cdbb787-fa8e-47fd-919f-21486c4cf74a-config-volume\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.154011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/120824b8-5c35-4031-994e-11128194c101-data-volume\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.154011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/120824b8-5c35-4031-994e-11128194c101-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.154011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cdbb787-fa8e-47fd-919f-21486c4cf74a-metrics-tls\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.154011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdbb787-fa8e-47fd-919f-21486c4cf74a-tmp-dir\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.154011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsqv\" (UniqueName: \"kubernetes.io/projected/120824b8-5c35-4031-994e-11128194c101-kube-api-access-qwsqv\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.154011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.153981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tggmc\" (UniqueName: \"kubernetes.io/projected/5cdbb787-fa8e-47fd-919f-21486c4cf74a-kube-api-access-tggmc\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.154291 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.154043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/120824b8-5c35-4031-994e-11128194c101-crio-socket\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.154291 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.154072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/120824b8-5c35-4031-994e-11128194c101-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/120824b8-5c35-4031-994e-11128194c101-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255107 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5cdbb787-fa8e-47fd-919f-21486c4cf74a-config-volume\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.255123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/120824b8-5c35-4031-994e-11128194c101-data-volume\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255343 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/120824b8-5c35-4031-994e-11128194c101-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255343 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cdbb787-fa8e-47fd-919f-21486c4cf74a-metrics-tls\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.255343 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdbb787-fa8e-47fd-919f-21486c4cf74a-tmp-dir\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.255343 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsqv\" (UniqueName: \"kubernetes.io/projected/120824b8-5c35-4031-994e-11128194c101-kube-api-access-qwsqv\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tggmc\" (UniqueName: \"kubernetes.io/projected/5cdbb787-fa8e-47fd-919f-21486c4cf74a-kube-api-access-tggmc\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.255521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkg2k\" (UniqueName: \"kubernetes.io/projected/75b1492c-2fd8-466f-a8c1-9042721e0113-kube-api-access-tkg2k\") pod \"ingress-canary-k55sv\" (UID: \"75b1492c-2fd8-466f-a8c1-9042721e0113\") " pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.255521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/120824b8-5c35-4031-994e-11128194c101-crio-socket\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75b1492c-2fd8-466f-a8c1-9042721e0113-cert\") pod \"ingress-canary-k55sv\" (UID: \"75b1492c-2fd8-466f-a8c1-9042721e0113\") " pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.255680 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/120824b8-5c35-4031-994e-11128194c101-data-volume\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255680 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdbb787-fa8e-47fd-919f-21486c4cf74a-tmp-dir\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.255774 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/120824b8-5c35-4031-994e-11128194c101-crio-socket\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.255829 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5cdbb787-fa8e-47fd-919f-21486c4cf74a-config-volume\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.255973 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.255954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/120824b8-5c35-4031-994e-11128194c101-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.259194 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.259162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cdbb787-fa8e-47fd-919f-21486c4cf74a-metrics-tls\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.259310 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.259165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/120824b8-5c35-4031-994e-11128194c101-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.266540 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.266518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsqv\" (UniqueName: \"kubernetes.io/projected/120824b8-5c35-4031-994e-11128194c101-kube-api-access-qwsqv\") pod \"insights-runtime-extractor-sk5hx\" (UID: \"120824b8-5c35-4031-994e-11128194c101\") " pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.266540 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.266533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tggmc\" (UniqueName: \"kubernetes.io/projected/5cdbb787-fa8e-47fd-919f-21486c4cf74a-kube-api-access-tggmc\") pod \"dns-default-ljsmw\" (UID: \"5cdbb787-fa8e-47fd-919f-21486c4cf74a\") " pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.309564 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.309530 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sk5hx" Jun 10 11:19:55.314124 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.314096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:55.356521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.356170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkg2k\" (UniqueName: \"kubernetes.io/projected/75b1492c-2fd8-466f-a8c1-9042721e0113-kube-api-access-tkg2k\") pod \"ingress-canary-k55sv\" (UID: \"75b1492c-2fd8-466f-a8c1-9042721e0113\") " pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.356521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.356223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75b1492c-2fd8-466f-a8c1-9042721e0113-cert\") pod \"ingress-canary-k55sv\" (UID: \"75b1492c-2fd8-466f-a8c1-9042721e0113\") " pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.359149 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.359116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75b1492c-2fd8-466f-a8c1-9042721e0113-cert\") pod \"ingress-canary-k55sv\" (UID: \"75b1492c-2fd8-466f-a8c1-9042721e0113\") " pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.367002 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.366956 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkg2k\" (UniqueName: \"kubernetes.io/projected/75b1492c-2fd8-466f-a8c1-9042721e0113-kube-api-access-tkg2k\") pod \"ingress-canary-k55sv\" (UID: \"75b1492c-2fd8-466f-a8c1-9042721e0113\") " pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.413147 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.413060 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k55sv" Jun 10 11:19:55.501267 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.501228 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ljsmw"] Jun 10 11:19:55.505166 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:55.504965 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdbb787_fa8e_47fd_919f_21486c4cf74a.slice/crio-3166b39eef78d6b211625cf06ec0427c66271e408bb7795873ec5c15df39caec WatchSource:0}: Error finding container 3166b39eef78d6b211625cf06ec0427c66271e408bb7795873ec5c15df39caec: Status 404 returned error can't find the container with id 3166b39eef78d6b211625cf06ec0427c66271e408bb7795873ec5c15df39caec Jun 10 11:19:55.512767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.512745 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sk5hx"] Jun 10 11:19:55.516033 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:55.516000 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120824b8_5c35_4031_994e_11128194c101.slice/crio-5fdfbf20c4731eef80a6f791edd221e7dbe7602669e71fabca87cd510608b073 WatchSource:0}: Error finding container 5fdfbf20c4731eef80a6f791edd221e7dbe7602669e71fabca87cd510608b073: Status 404 returned error can't find the container with id 5fdfbf20c4731eef80a6f791edd221e7dbe7602669e71fabca87cd510608b073 Jun 10 11:19:55.571291 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.571255 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k55sv"] Jun 10 11:19:55.575270 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:55.575241 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b1492c_2fd8_466f_a8c1_9042721e0113.slice/crio-e01f590e6635e03f33ac71d24468992b7086cc416f284fb7dec9522ee9705960 WatchSource:0}: Error finding container e01f590e6635e03f33ac71d24468992b7086cc416f284fb7dec9522ee9705960: Status 404 returned error can't find the container with id e01f590e6635e03f33ac71d24468992b7086cc416f284fb7dec9522ee9705960 Jun 10 11:19:55.592878 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.592859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:19:55.592974 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.592959 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:19:55.593114 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.593091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:19:55.599064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.599041 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xq8q5\"" Jun 10 11:19:55.599064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.599056 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:19:55.599249 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.599086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:19:55.599249 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.599089 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:19:55.600237 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.600219 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:19:55.600473 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.600455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqxnp\"" Jun 10 11:19:55.792524 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.792431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k55sv" event={"ID":"75b1492c-2fd8-466f-a8c1-9042721e0113","Type":"ContainerStarted","Data":"e01f590e6635e03f33ac71d24468992b7086cc416f284fb7dec9522ee9705960"} Jun 10 11:19:55.793445 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.793415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljsmw" event={"ID":"5cdbb787-fa8e-47fd-919f-21486c4cf74a","Type":"ContainerStarted","Data":"3166b39eef78d6b211625cf06ec0427c66271e408bb7795873ec5c15df39caec"} Jun 10 11:19:55.794774 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.794755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sk5hx" event={"ID":"120824b8-5c35-4031-994e-11128194c101","Type":"ContainerStarted","Data":"0a537c69236efc6ed3e372026c6fe783cd245b409a481052ac03888d169e3040"} Jun 10 11:19:55.794855 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:55.794796 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sk5hx" event={"ID":"120824b8-5c35-4031-994e-11128194c101","Type":"ContainerStarted","Data":"5fdfbf20c4731eef80a6f791edd221e7dbe7602669e71fabca87cd510608b073"} Jun 10 11:19:56.088798 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.088708 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl"] Jun 10 11:19:56.092262 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.092234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.095369 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.095343 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 11:19:56.096526 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.096489 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 11:19:56.097066 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.096719 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 11:19:56.097066 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.096781 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 11:19:56.097066 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.096796 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mks5j\"" Jun 10 11:19:56.097066 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.096927 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 11:19:56.101789 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.101703 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl"] Jun 10 11:19:56.263759 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.263725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.263929 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.263772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.263929 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.263816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.263929 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.263852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk2wj\" (UniqueName: \"kubernetes.io/projected/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-kube-api-access-bk2wj\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.364537 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.364450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk2wj\" (UniqueName: \"kubernetes.io/projected/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-kube-api-access-bk2wj\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.364706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.364549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.364706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.364574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.364706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.364613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.365626 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.365599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.367915 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.367891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.368717 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.368690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.378121 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.378089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk2wj\" (UniqueName: \"kubernetes.io/projected/e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca-kube-api-access-bk2wj\") pod \"prometheus-operator-7f7d445d84-l7gcl\" (UID: \"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.404825 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.404793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" Jun 10 11:19:56.568239 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.568207 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl"] Jun 10 11:19:56.571385 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:19:56.571360 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c5a778_8ed5_404b_a49d_0ffc7c5c02ca.slice/crio-a49a7737ebb517309d1a68428f76eb694a1a77c4a3ab84249bb8c2f0cfb42b61 WatchSource:0}: Error finding container a49a7737ebb517309d1a68428f76eb694a1a77c4a3ab84249bb8c2f0cfb42b61: Status 404 returned error can't find the container with id a49a7737ebb517309d1a68428f76eb694a1a77c4a3ab84249bb8c2f0cfb42b61 Jun 10 11:19:56.801074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.801023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" event={"ID":"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca","Type":"ContainerStarted","Data":"a49a7737ebb517309d1a68428f76eb694a1a77c4a3ab84249bb8c2f0cfb42b61"} Jun 10 11:19:56.804197 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:56.804099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sk5hx" event={"ID":"120824b8-5c35-4031-994e-11128194c101","Type":"ContainerStarted","Data":"871a641878c5a39dab2425383953b53b789c4ca25e8893edcc34fbb1ff455de3"} Jun 10 11:19:58.814458 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.814364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sk5hx" event={"ID":"120824b8-5c35-4031-994e-11128194c101","Type":"ContainerStarted","Data":"e5904057faf4fa717e687b0b65c6644f2aa901b2f6c5038d6b419c0bfb11e933"} Jun 10 11:19:58.817055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.816979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k55sv" event={"ID":"75b1492c-2fd8-466f-a8c1-9042721e0113","Type":"ContainerStarted","Data":"4b0c6d9f1f66c4641f51a584bb7f4ac5a8126c5707e3f292562a64e82126a534"} Jun 10 11:19:58.819956 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.819924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljsmw" event={"ID":"5cdbb787-fa8e-47fd-919f-21486c4cf74a","Type":"ContainerStarted","Data":"8691458cb2a40b5df1f2e0f9d2c546a02b4e0d15373db8097e99cfb44ea99000"} Jun 10 11:19:58.820102 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.819999 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ljsmw" Jun 10 11:19:58.820102 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.820030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljsmw" event={"ID":"5cdbb787-fa8e-47fd-919f-21486c4cf74a","Type":"ContainerStarted","Data":"78222c3e27e5f44206e36425d8e09b1c5c23538224f923c0febb511119aa19d8"} Jun 10 11:19:58.821997 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.821972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" event={"ID":"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca","Type":"ContainerStarted","Data":"068300eb620203796b8d6fa573f8fdb0eb8c22462406de38cd7c85817cabb593"} Jun 10 11:19:58.822112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.822012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" event={"ID":"e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca","Type":"ContainerStarted","Data":"922edd1e1b13ab0ea7190e9882cd013ff547dbcd27a127261289bb13795fa576"} Jun 10 11:19:58.838280 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.838163 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sk5hx" podStartSLOduration=1.9288675629999998 podStartE2EDuration="4.838143423s" totalImagesPullingTime="2.90927586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:58.837321644 +0000 UTC m=+44.680398601" watchObservedRunningTime="2026-06-10 11:19:58.838143423 +0000 UTC m=+44.681220343" Jun 10 11:19:58.860706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.860653 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ljsmw" podStartSLOduration=1.787448558 podStartE2EDuration="4.8606347s" totalImagesPullingTime="3.073186142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:58.860300682 +0000 UTC m=+44.703377635" watchObservedRunningTime="2026-06-10 11:19:58.8606347 +0000 UTC m=+44.703711662" Jun 10 11:19:58.879132 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.879080 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-l7gcl" podStartSLOduration=0.807066395 podStartE2EDuration="2.879062872s" totalImagesPullingTime="2.071996477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:58.878847689 +0000 UTC m=+44.721924644" watchObservedRunningTime="2026-06-10 11:19:58.879062872 +0000 UTC m=+44.722139765" Jun 10 11:19:58.901811 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:19:58.901760 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k55sv" podStartSLOduration=0.898322667 podStartE2EDuration="3.901741473s" totalImagesPullingTime="3.003418806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:19:58.901235726 +0000 UTC m=+44.744312643" watchObservedRunningTime="2026-06-10 11:19:58.901741473 +0000 UTC m=+44.744818367" Jun 10 11:20:00.340692 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.340658 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5f8fc64b-thzr5"] Jun 10 11:20:00.374342 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.374310 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5f8fc64b-thzr5"] Jun 10 11:20:00.374480 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.374423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.377755 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.377731 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:20:00.377924 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.377777 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:20:00.377924 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.377796 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:20:00.379131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.379100 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:20:00.379258 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.379133 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:20:00.379258 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.379159 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:20:00.379454 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.379442 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x9nhm\"" Jun 10 11:20:00.379534 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.379514 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:20:00.386530 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.386506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 11:20:00.395361 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-trusted-ca-bundle\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.395501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-oauth-config\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.395501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-oauth-serving-cert\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.395501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhq7\" (UniqueName: \"kubernetes.io/projected/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-kube-api-access-nwhq7\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.395501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-config\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.395704 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-serving-cert\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.395704 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.395599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-service-ca\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496287 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-serving-cert\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496459 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-service-ca\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496459 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-trusted-ca-bundle\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496586 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-oauth-config\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496586 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-oauth-serving-cert\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496586 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhq7\" (UniqueName: \"kubernetes.io/projected/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-kube-api-access-nwhq7\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.496586 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.496570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-config\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.497301 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.497273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-service-ca\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.497431 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.497396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-oauth-serving-cert\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.497431 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.497398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-config\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.497573 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.497549 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56"] Jun 10 11:20:00.497643 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.497626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-trusted-ca-bundle\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.499213 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.499168 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-serving-cert\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.499345 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.499330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-oauth-config\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.508561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.508529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhq7\" (UniqueName: \"kubernetes.io/projected/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-kube-api-access-nwhq7\") pod \"console-5f5f8fc64b-thzr5\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.534165 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.534133 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56"] Jun 10 11:20:00.534330 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.534265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.537087 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.537046 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 11:20:00.537087 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.537064 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 11:20:00.537282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.537191 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gprg8\"" Jun 10 11:20:00.547095 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.547073 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qr7js"] Jun 10 11:20:00.562790 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.562755 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx"] Jun 10 11:20:00.562918 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.562890 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.565661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.565637 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 11:20:00.565747 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.565687 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 11:20:00.566011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.565993 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d9zgw\"" Jun 10 11:20:00.566051 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.566023 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 11:20:00.584695 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.584659 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx"] Jun 10 11:20:00.584837 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.584785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.588501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.588477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 11:20:00.589155 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.589137 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 11:20:00.589155 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.589138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9p5dm\"" Jun 10 11:20:00.589562 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.589546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 11:20:00.597903 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.597876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gchlt\" (UniqueName: \"kubernetes.io/projected/605e6c89-0289-4563-aaf7-2e0c48c52e0e-kube-api-access-gchlt\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.598047 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.597915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-root\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598047 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.597940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfrbm\" (UniqueName: \"kubernetes.io/projected/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-api-access-tfrbm\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.598047 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.597971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/605e6c89-0289-4563-aaf7-2e0c48c52e0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.598047 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.597990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/605e6c89-0289-4563-aaf7-2e0c48c52e0e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.598047 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605e6c89-0289-4563-aaf7-2e0c48c52e0e-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-sys\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4h8l\" (UniqueName: \"kubernetes.io/projected/48eefd03-4e72-4042-b9ee-902ad373fa1b-kube-api-access-k4h8l\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-tls\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48eefd03-4e72-4042-b9ee-902ad373fa1b-metrics-client-ca\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.598355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-wtmp\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598817 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-textfile\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.598817 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.598389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.684098 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.684063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:00.699083 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699083 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699346 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605e6c89-0289-4563-aaf7-2e0c48c52e0e-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.699346 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-sys\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699346 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4h8l\" (UniqueName: \"kubernetes.io/projected/48eefd03-4e72-4042-b9ee-902ad373fa1b-kube-api-access-k4h8l\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699346 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-sys\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699346 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-tls\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48eefd03-4e72-4042-b9ee-902ad373fa1b-metrics-client-ca\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-wtmp\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-textfile\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gchlt\" (UniqueName: \"kubernetes.io/projected/605e6c89-0289-4563-aaf7-2e0c48c52e0e-kube-api-access-gchlt\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-root\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfrbm\" (UniqueName: \"kubernetes.io/projected/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-api-access-tfrbm\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/605e6c89-0289-4563-aaf7-2e0c48c52e0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/605e6c89-0289-4563-aaf7-2e0c48c52e0e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605e6c89-0289-4563-aaf7-2e0c48c52e0e-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.699981 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.700661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.700661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.700041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.700767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.699946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-wtmp\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.700767 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:00.700700 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 11:20:00.700767 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:00.700762 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-tls podName:de501e9c-f4b9-47e4-b7d4-2aa4f999437e nodeName:}" failed. No retries permitted until 2026-06-10 11:20:01.200744742 +0000 UTC m=+47.043821641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-h9dsx" (UID: "de501e9c-f4b9-47e4-b7d4-2aa4f999437e") : secret "kube-state-metrics-tls" not found Jun 10 11:20:00.701058 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.701003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48eefd03-4e72-4042-b9ee-902ad373fa1b-root\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.701240 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.701162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-textfile\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.701903 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.701340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.701903 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.701479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.701903 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.701723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.702151 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.702000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48eefd03-4e72-4042-b9ee-902ad373fa1b-metrics-client-ca\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.702275 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.702252 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.702979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.702950 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48eefd03-4e72-4042-b9ee-902ad373fa1b-node-exporter-tls\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.703201 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.703162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.703877 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.703855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/605e6c89-0289-4563-aaf7-2e0c48c52e0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.704383 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.704365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/605e6c89-0289-4563-aaf7-2e0c48c52e0e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.719813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.719778 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gchlt\" (UniqueName: \"kubernetes.io/projected/605e6c89-0289-4563-aaf7-2e0c48c52e0e-kube-api-access-gchlt\") pod \"openshift-state-metrics-65f78d5c66-c7m56\" (UID: \"605e6c89-0289-4563-aaf7-2e0c48c52e0e\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.719950 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.719928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfrbm\" (UniqueName: \"kubernetes.io/projected/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-api-access-tfrbm\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:00.722166 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.721089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4h8l\" (UniqueName: \"kubernetes.io/projected/48eefd03-4e72-4042-b9ee-902ad373fa1b-kube-api-access-k4h8l\") pod \"node-exporter-qr7js\" (UID: \"48eefd03-4e72-4042-b9ee-902ad373fa1b\") " pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.835394 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.835362 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5f8fc64b-thzr5"] Jun 10 11:20:00.838779 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:00.838757 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdd1c6e_5c7c_4b6c_8deb_3feee4105447.slice/crio-f143a98d67576c672f765e44c07eba035b92745ddfd42afc8d31ab11f1ab6312 WatchSource:0}: Error finding container f143a98d67576c672f765e44c07eba035b92745ddfd42afc8d31ab11f1ab6312: Status 404 returned error can't find the container with id f143a98d67576c672f765e44c07eba035b92745ddfd42afc8d31ab11f1ab6312 Jun 10 11:20:00.843568 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.843546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" Jun 10 11:20:00.872341 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.872315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qr7js" Jun 10 11:20:00.911281 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:00.911232 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48eefd03_4e72_4042_b9ee_902ad373fa1b.slice/crio-33822b6323925e5d4fa798558b1c3e5319f6d22d03411aa355be4498ff5c79a3 WatchSource:0}: Error finding container 33822b6323925e5d4fa798558b1c3e5319f6d22d03411aa355be4498ff5c79a3: Status 404 returned error can't find the container with id 33822b6323925e5d4fa798558b1c3e5319f6d22d03411aa355be4498ff5c79a3 Jun 10 11:20:00.993011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:00.992972 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56"] Jun 10 11:20:00.996465 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:00.996437 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605e6c89_0289_4563_aaf7_2e0c48c52e0e.slice/crio-9e1bdd7e353b5228628f07b18626589eb231e02fd75660ea2a8d95d5df947e88 WatchSource:0}: Error finding container 9e1bdd7e353b5228628f07b18626589eb231e02fd75660ea2a8d95d5df947e88: Status 404 returned error can't find the container with id 9e1bdd7e353b5228628f07b18626589eb231e02fd75660ea2a8d95d5df947e88 Jun 10 11:20:01.204653 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.204617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:01.206874 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.206853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de501e9c-f4b9-47e4-b7d4-2aa4f999437e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-h9dsx\" (UID: \"de501e9c-f4b9-47e4-b7d4-2aa4f999437e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:01.495153 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.495116 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" Jun 10 11:20:01.546510 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.546478 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:01.567559 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.567506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.570842 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.570812 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.571032 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.571240 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.571860 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.571877 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.572071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.572087 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vmp6k\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.572223 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.572316 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 11:20:01.572505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.572376 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 11:20:01.576665 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.576575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:01.608970 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.608359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.609143 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.609005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.609143 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.609077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.609143 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.609111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.609322 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.609144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.609322 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.609298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5lh\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-kube-api-access-ft5lh\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.609937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.610006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.610047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.610092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-out\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.610109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610411 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.610149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.610411 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.610187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-web-config\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.687466 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.687427 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx"] Jun 10 11:20:01.692080 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:01.692046 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde501e9c_f4b9_47e4_b7d4_2aa4f999437e.slice/crio-b5f0314706ca581bd8ef01a9ad3fa49ba44d0aa6c4618631804134e9ff691b40 WatchSource:0}: Error finding container b5f0314706ca581bd8ef01a9ad3fa49ba44d0aa6c4618631804134e9ff691b40: Status 404 returned error can't find the container with id b5f0314706ca581bd8ef01a9ad3fa49ba44d0aa6c4618631804134e9ff691b40 Jun 10 11:20:01.711531 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711687 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-out\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711687 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711687 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711853 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-web-config\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711853 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711853 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.711988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5lh\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-kube-api-access-ft5lh\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.712198 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.711995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.712198 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.712044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.713122 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:01.712307 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle podName:71d126d7-704d-4d17-8ea7-04b99198bc4c nodeName:}" failed. No retries permitted until 2026-06-10 11:20:02.212282374 +0000 UTC m=+48.055359282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c") : configmap references non-existent config key: ca-bundle.crt Jun 10 11:20:01.713122 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:01.712522 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 11:20:01.713122 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:01.712576 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls podName:71d126d7-704d-4d17-8ea7-04b99198bc4c nodeName:}" failed. No retries permitted until 2026-06-10 11:20:02.212559926 +0000 UTC m=+48.055636822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c") : secret "alertmanager-main-tls" not found Jun 10 11:20:01.713122 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.712812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.713122 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.713069 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.715253 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.715022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-out\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.715549 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.715526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-web-config\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.715925 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.715892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.716404 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.716359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.716749 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.716538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.716749 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.716628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.717774 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.717736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.718650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.718622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.724994 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.724921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5lh\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-kube-api-access-ft5lh\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:01.842887 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.842801 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" event={"ID":"605e6c89-0289-4563-aaf7-2e0c48c52e0e","Type":"ContainerStarted","Data":"2b50d31ad03b6d1db67b6fab84edb81f303caa07a3ce9f8eb6255942c864fa89"} Jun 10 11:20:01.842887 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.842871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" event={"ID":"605e6c89-0289-4563-aaf7-2e0c48c52e0e","Type":"ContainerStarted","Data":"2f8f22cf2bfb4fca022e9ed2f757a0321a78e0df2d57416c9e134d279fd6d367"} Jun 10 11:20:01.843081 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.842898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" event={"ID":"605e6c89-0289-4563-aaf7-2e0c48c52e0e","Type":"ContainerStarted","Data":"9e1bdd7e353b5228628f07b18626589eb231e02fd75660ea2a8d95d5df947e88"} Jun 10 11:20:01.844237 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.844204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qr7js" event={"ID":"48eefd03-4e72-4042-b9ee-902ad373fa1b","Type":"ContainerStarted","Data":"33822b6323925e5d4fa798558b1c3e5319f6d22d03411aa355be4498ff5c79a3"} Jun 10 11:20:01.845532 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.845507 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f8fc64b-thzr5" event={"ID":"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447","Type":"ContainerStarted","Data":"f143a98d67576c672f765e44c07eba035b92745ddfd42afc8d31ab11f1ab6312"} Jun 10 11:20:01.846713 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:01.846687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" event={"ID":"de501e9c-f4b9-47e4-b7d4-2aa4f999437e","Type":"ContainerStarted","Data":"b5f0314706ca581bd8ef01a9ad3fa49ba44d0aa6c4618631804134e9ff691b40"} Jun 10 11:20:02.216954 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.216880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:02.217089 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.216989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:02.217866 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.217840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:02.219609 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.219587 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:02.481559 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.481524 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:02.655574 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.655535 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cfb898f46-g2zs5"] Jun 10 11:20:02.667931 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.667448 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.690529 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.690498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 11:20:02.690678 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.690558 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 11:20:02.690738 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.690498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 11:20:02.696761 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.696717 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 11:20:02.696926 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.696810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 11:20:02.697419 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.697389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gjpgp\"" Jun 10 11:20:02.697738 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.697677 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3oetonm3r583l\"" Jun 10 11:20:02.723049 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723229 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723229 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2643a-bbd6-4191-a688-25c7e161ac3e-metrics-client-ca\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723350 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-grpc-tls\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723350 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-tls\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723350 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723498 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.723498 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.723436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skdpl\" (UniqueName: \"kubernetes.io/projected/1bb2643a-bbd6-4191-a688-25c7e161ac3e-kube-api-access-skdpl\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.757777 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.757673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cfb898f46-g2zs5"] Jun 10 11:20:02.759597 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.759404 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:02.824252 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-grpc-tls\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824409 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-tls\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824409 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824409 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824545 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skdpl\" (UniqueName: \"kubernetes.io/projected/1bb2643a-bbd6-4191-a688-25c7e161ac3e-kube-api-access-skdpl\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824545 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824545 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.824545 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.824540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2643a-bbd6-4191-a688-25c7e161ac3e-metrics-client-ca\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.825819 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.825784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2643a-bbd6-4191-a688-25c7e161ac3e-metrics-client-ca\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.827398 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.827340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-grpc-tls\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.828516 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.828463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.828805 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.828777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-tls\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.829029 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.828985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.829200 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.829158 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.829289 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.829251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1bb2643a-bbd6-4191-a688-25c7e161ac3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.847017 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.846843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skdpl\" (UniqueName: \"kubernetes.io/projected/1bb2643a-bbd6-4191-a688-25c7e161ac3e-kube-api-access-skdpl\") pod \"thanos-querier-cfb898f46-g2zs5\" (UID: \"1bb2643a-bbd6-4191-a688-25c7e161ac3e\") " pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:02.853152 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.853110 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qr7js" event={"ID":"48eefd03-4e72-4042-b9ee-902ad373fa1b","Type":"ContainerStarted","Data":"8489eb7bdae66dec01da1421d259471e95bbf4c21607628154268e80d7329464"} Jun 10 11:20:02.981115 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:02.981082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:03.008814 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:03.008781 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d126d7_704d_4d17_8ea7_04b99198bc4c.slice/crio-fba0f15839f4774f8ff7d25c02de790ea8c7563e0b9d7eb7553b6c5d18155dc3 WatchSource:0}: Error finding container fba0f15839f4774f8ff7d25c02de790ea8c7563e0b9d7eb7553b6c5d18155dc3: Status 404 returned error can't find the container with id fba0f15839f4774f8ff7d25c02de790ea8c7563e0b9d7eb7553b6c5d18155dc3 Jun 10 11:20:03.858786 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:03.858689 2563 generic.go:356] "Generic (PLEG): container finished" podID="48eefd03-4e72-4042-b9ee-902ad373fa1b" containerID="8489eb7bdae66dec01da1421d259471e95bbf4c21607628154268e80d7329464" exitCode=0 Jun 10 11:20:03.859268 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:03.858784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qr7js" event={"ID":"48eefd03-4e72-4042-b9ee-902ad373fa1b","Type":"ContainerDied","Data":"8489eb7bdae66dec01da1421d259471e95bbf4c21607628154268e80d7329464"} Jun 10 11:20:03.860286 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:03.860257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"fba0f15839f4774f8ff7d25c02de790ea8c7563e0b9d7eb7553b6c5d18155dc3"} Jun 10 11:20:04.899054 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.899019 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9c66db8b9-5kd28"] Jun 10 11:20:04.923684 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.923655 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:04.924382 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.924359 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9c66db8b9-5kd28"] Jun 10 11:20:04.927726 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.927699 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 11:20:04.928884 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.928860 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vpr8f\"" Jun 10 11:20:04.929127 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.929110 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 11:20:04.929232 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.929125 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 11:20:04.929295 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.929265 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 11:20:04.929396 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:04.929381 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-csiku7tconat3\"" Jun 10 11:20:05.044553 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b955f1f7-500a-4c3b-a532-e951356544d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.044553 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b955f1f7-500a-4c3b-a532-e951356544d9-metrics-server-audit-profiles\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.044780 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b955f1f7-500a-4c3b-a532-e951356544d9-audit-log\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.044780 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044628 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-client-ca-bundle\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.044780 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-secret-metrics-server-client-certs\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.044780 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cns98\" (UniqueName: \"kubernetes.io/projected/b955f1f7-500a-4c3b-a532-e951356544d9-kube-api-access-cns98\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.044993 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.044808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-secret-metrics-server-tls\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145597 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b955f1f7-500a-4c3b-a532-e951356544d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b955f1f7-500a-4c3b-a532-e951356544d9-metrics-server-audit-profiles\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b955f1f7-500a-4c3b-a532-e951356544d9-audit-log\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-client-ca-bundle\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145914 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-secret-metrics-server-client-certs\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145914 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cns98\" (UniqueName: \"kubernetes.io/projected/b955f1f7-500a-4c3b-a532-e951356544d9-kube-api-access-cns98\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.145914 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.145839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-secret-metrics-server-tls\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.146127 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.146082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b955f1f7-500a-4c3b-a532-e951356544d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.147233 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.147159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b955f1f7-500a-4c3b-a532-e951356544d9-metrics-server-audit-profiles\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.147338 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.147287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b955f1f7-500a-4c3b-a532-e951356544d9-audit-log\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.148985 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.148963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-client-ca-bundle\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.149457 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.149425 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-secret-metrics-server-client-certs\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.149457 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.149453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b955f1f7-500a-4c3b-a532-e951356544d9-secret-metrics-server-tls\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.167842 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.167817 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cns98\" (UniqueName: \"kubernetes.io/projected/b955f1f7-500a-4c3b-a532-e951356544d9-kube-api-access-cns98\") pod \"metrics-server-9c66db8b9-5kd28\" (UID: \"b955f1f7-500a-4c3b-a532-e951356544d9\") " pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.190286 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.190212 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cfb898f46-g2zs5"] Jun 10 11:20:05.193383 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:05.193348 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb2643a_bbd6_4191_a688_25c7e161ac3e.slice/crio-f0b1ee63637e3d5953be804908f1251ba0c761d0d0c474196fe5ce14645b53a2 WatchSource:0}: Error finding container f0b1ee63637e3d5953be804908f1251ba0c761d0d0c474196fe5ce14645b53a2: Status 404 returned error can't find the container with id f0b1ee63637e3d5953be804908f1251ba0c761d0d0c474196fe5ce14645b53a2 Jun 10 11:20:05.233666 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.233335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:05.278912 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.278875 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh"] Jun 10 11:20:05.297939 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.295822 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.302570 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.301522 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 11:20:05.302570 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.302278 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gbldr\"" Jun 10 11:20:05.312561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.309333 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh"] Jun 10 11:20:05.348670 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.348498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/902446ec-6df9-421b-a1b3-6a221c9d0f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.348670 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.348571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkv6g\" (UniqueName: \"kubernetes.io/projected/902446ec-6df9-421b-a1b3-6a221c9d0f9e-kube-api-access-xkv6g\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.449828 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.449797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/902446ec-6df9-421b-a1b3-6a221c9d0f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.450010 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.449845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkv6g\" (UniqueName: \"kubernetes.io/projected/902446ec-6df9-421b-a1b3-6a221c9d0f9e-kube-api-access-xkv6g\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.450079 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:05.450006 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 11:20:05.450131 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:05.450089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/902446ec-6df9-421b-a1b3-6a221c9d0f9e-monitoring-plugin-cert podName:902446ec-6df9-421b-a1b3-6a221c9d0f9e nodeName:}" failed. No retries permitted until 2026-06-10 11:20:05.950063495 +0000 UTC m=+51.793140404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/902446ec-6df9-421b-a1b3-6a221c9d0f9e-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-kdzbh" (UID: "902446ec-6df9-421b-a1b3-6a221c9d0f9e") : secret "monitoring-plugin-cert" not found Jun 10 11:20:05.459279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.459249 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9c66db8b9-5kd28"] Jun 10 11:20:05.465372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.465347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkv6g\" (UniqueName: \"kubernetes.io/projected/902446ec-6df9-421b-a1b3-6a221c9d0f9e-kube-api-access-xkv6g\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.749166 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:05.749130 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb955f1f7_500a_4c3b_a532_e951356544d9.slice/crio-a736e03fb22eb7c87e2cb952dd5adf98894111cb73715627d6702d814f36023c WatchSource:0}: Error finding container a736e03fb22eb7c87e2cb952dd5adf98894111cb73715627d6702d814f36023c: Status 404 returned error can't find the container with id a736e03fb22eb7c87e2cb952dd5adf98894111cb73715627d6702d814f36023c Jun 10 11:20:05.869242 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.869207 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" event={"ID":"b955f1f7-500a-4c3b-a532-e951356544d9","Type":"ContainerStarted","Data":"a736e03fb22eb7c87e2cb952dd5adf98894111cb73715627d6702d814f36023c"} Jun 10 11:20:05.872191 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.872125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" event={"ID":"605e6c89-0289-4563-aaf7-2e0c48c52e0e","Type":"ContainerStarted","Data":"e88d6da60ffabcc34a9ed2b95143caa450d1658f8a4bf9ea9246be3574d2d293"} Jun 10 11:20:05.874666 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.874638 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qr7js" event={"ID":"48eefd03-4e72-4042-b9ee-902ad373fa1b","Type":"ContainerStarted","Data":"f973664c59ee6f697c7494f28a56f4550aec6cee29dacedbae8e49f34b6f62e6"} Jun 10 11:20:05.874789 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.874684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qr7js" event={"ID":"48eefd03-4e72-4042-b9ee-902ad373fa1b","Type":"ContainerStarted","Data":"fddda303923c82551f4503c086727a78f535d771f2312730b786a2da4b835515"} Jun 10 11:20:05.876236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.876212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f8fc64b-thzr5" event={"ID":"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447","Type":"ContainerStarted","Data":"8a18b0b0e0002f8818b2f2149a91ca11dd7eba185721c4748e1283a903e976cb"} Jun 10 11:20:05.878229 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.878200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" event={"ID":"de501e9c-f4b9-47e4-b7d4-2aa4f999437e","Type":"ContainerStarted","Data":"b418c3fa1b3e3f898cd61c74255fb71c484658248a58d4f722d37ea9bee20e67"} Jun 10 11:20:05.878336 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.878255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" event={"ID":"de501e9c-f4b9-47e4-b7d4-2aa4f999437e","Type":"ContainerStarted","Data":"dbb1109adcf37f2fbb448daa0561e8562343cdde58c9ab2c9f33830a7b8b849a"} Jun 10 11:20:05.878336 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.878286 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" event={"ID":"de501e9c-f4b9-47e4-b7d4-2aa4f999437e","Type":"ContainerStarted","Data":"c1fc9e84aa9109fa04aa2fbc281abeb8de95f489c92f65a2e04a0300e3b20275"} Jun 10 11:20:05.879472 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.879454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"f0b1ee63637e3d5953be804908f1251ba0c761d0d0c474196fe5ce14645b53a2"} Jun 10 11:20:05.892641 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.892599 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-c7m56" podStartSLOduration=2.117762437 podStartE2EDuration="5.89258378s" totalImagesPullingTime="3.774821343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:05.891401972 +0000 UTC m=+51.734478929" watchObservedRunningTime="2026-06-10 11:20:05.89258378 +0000 UTC m=+51.735660687" Jun 10 11:20:05.916045 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.915987 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5f8fc64b-thzr5" podStartSLOduration=1.733205664 podStartE2EDuration="5.915970903s" totalImagesPullingTime="4.182765239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:05.915435573 +0000 UTC m=+51.758512498" watchObservedRunningTime="2026-06-10 11:20:05.915970903 +0000 UTC m=+51.759047819" Jun 10 11:20:05.937948 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.937893 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qr7js" podStartSLOduration=4.237047532 podStartE2EDuration="5.937876192s" totalImagesPullingTime="1.574691972s" totalInitContainerRuntime="126.136688ms" isStatefulPod=true podCreationTimestamp="2026-06-10 11:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:05.936733043 +0000 UTC m=+51.779809996" watchObservedRunningTime="2026-06-10 11:20:05.937876192 +0000 UTC m=+51.780953109" Jun 10 11:20:05.956627 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.956586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/902446ec-6df9-421b-a1b3-6a221c9d0f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:05.962300 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.962251 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-h9dsx" podStartSLOduration=2.631779962 podStartE2EDuration="5.962234137s" totalImagesPullingTime="3.330454175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:05.958576556 +0000 UTC m=+51.801653473" watchObservedRunningTime="2026-06-10 11:20:05.962234137 +0000 UTC m=+51.805311053" Jun 10 11:20:05.964120 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:05.964101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/902446ec-6df9-421b-a1b3-6a221c9d0f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kdzbh\" (UID: \"902446ec-6df9-421b-a1b3-6a221c9d0f9e\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:06.142274 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.142149 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5f8fc64b-thzr5"] Jun 10 11:20:06.173639 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.173612 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7447898478-495rg"] Jun 10 11:20:06.194452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.194421 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7447898478-495rg"] Jun 10 11:20:06.194577 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.194558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.217313 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.217284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:06.260614 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.260577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpzzm\" (UniqueName: \"kubernetes.io/projected/92b835c3-3984-4943-80b7-9bb0320b2e52-kube-api-access-lpzzm\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.260748 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.260627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-serving-cert\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.260748 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.260663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-oauth-serving-cert\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.260824 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.260745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-oauth-config\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.260824 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.260775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-console-config\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.260996 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.260977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-service-ca\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.261056 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.261032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-trusted-ca-bundle\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.361971 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.361935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-trusted-ca-bundle\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.361980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpzzm\" (UniqueName: \"kubernetes.io/projected/92b835c3-3984-4943-80b7-9bb0320b2e52-kube-api-access-lpzzm\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.362005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-serving-cert\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.362222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-oauth-serving-cert\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.362328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-oauth-config\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.362362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-console-config\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.362470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-service-ca\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.362982 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.362921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-oauth-serving-cert\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.363115 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.363081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-console-config\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.363198 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.363114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-service-ca\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.363198 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.363154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-trusted-ca-bundle\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.365966 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.365254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-serving-cert\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.365966 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.365285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-oauth-config\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.372125 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.372099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpzzm\" (UniqueName: \"kubernetes.io/projected/92b835c3-3984-4943-80b7-9bb0320b2e52-kube-api-access-lpzzm\") pod \"console-7447898478-495rg\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.400055 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.400002 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh"] Jun 10 11:20:06.402894 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:06.402855 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902446ec_6df9_421b_a1b3_6a221c9d0f9e.slice/crio-08990af145293ae901b61972709cd0d0f8d5ddf09fc5158466484fd74515e49a WatchSource:0}: Error finding container 08990af145293ae901b61972709cd0d0f8d5ddf09fc5158466484fd74515e49a: Status 404 returned error can't find the container with id 08990af145293ae901b61972709cd0d0f8d5ddf09fc5158466484fd74515e49a Jun 10 11:20:06.505256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.505219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:06.686872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.686836 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7447898478-495rg"] Jun 10 11:20:06.889417 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.889377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447898478-495rg" event={"ID":"92b835c3-3984-4943-80b7-9bb0320b2e52","Type":"ContainerStarted","Data":"f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377"} Jun 10 11:20:06.889583 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.889438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447898478-495rg" event={"ID":"92b835c3-3984-4943-80b7-9bb0320b2e52","Type":"ContainerStarted","Data":"28f50ac196fc732950d48778223828ac5f1e98540e6ef4db45cb3f87ad602397"} Jun 10 11:20:06.892236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.892207 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="abe023831226493971f1f6b2064e2e6c07437e82fc38d956b7f1f37f4184092d" exitCode=0 Jun 10 11:20:06.892373 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.892285 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"abe023831226493971f1f6b2064e2e6c07437e82fc38d956b7f1f37f4184092d"} Jun 10 11:20:06.896086 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.896002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" event={"ID":"902446ec-6df9-421b-a1b3-6a221c9d0f9e","Type":"ContainerStarted","Data":"08990af145293ae901b61972709cd0d0f8d5ddf09fc5158466484fd74515e49a"} Jun 10 11:20:06.917255 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.916927 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7447898478-495rg" podStartSLOduration=0.91690566 podStartE2EDuration="916.90566ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:06.916059512 +0000 UTC m=+52.759136429" watchObservedRunningTime="2026-06-10 11:20:06.91690566 +0000 UTC m=+52.759982577" Jun 10 11:20:06.989059 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:06.989011 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:07.012353 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.012317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.016728 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.016695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.016955 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.017153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.017409 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.017675 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.018753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.019007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.019268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.019445 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.019628 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.019894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-km9tt\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.020938 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7d7a8vrdvkukn\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.021141 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.021153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 11:20:07.024836 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.023080 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 11:20:07.030044 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.030017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 11:20:07.030498 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.030468 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:07.071300 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.070963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.071300 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4s2l\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-kube-api-access-r4s2l\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071889 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-web-config\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.071997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-config\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.072108 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.072022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.073017 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.072045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.073017 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.072093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-config-out\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173413 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173607 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173607 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173607 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4s2l\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-kube-api-access-r4s2l\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173769 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173769 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173863 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173863 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-web-config\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.173863 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-config\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174004 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174004 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174004 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-config-out\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174004 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.173990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.174703 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.175053 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.174838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.176126 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.175771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.176126 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.176096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.176815 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.176617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.176815 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.176698 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.177971 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.177720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.178582 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.178135 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.178582 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.178542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.178582 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.178550 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.178913 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.178860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-config-out\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.179030 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.179018 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.179408 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.179385 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.180167 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.180147 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-config\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.180282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.180193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.181336 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.181310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.181808 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.181784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-web-config\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.182133 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.182111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.182524 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.182502 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.184193 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.184157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4s2l\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-kube-api-access-r4s2l\") pod \"prometheus-k8s-0\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:07.331686 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:07.331533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:08.833391 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:08.833280 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ljsmw" Jun 10 11:20:09.554341 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.554314 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:09.557031 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:09.556999 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6811c968_d3d4_46b2_a90e_28a337c3541d.slice/crio-998c84dd177bc429eacd458218d461c515a4f5338690f2d808caa14a639304a4 WatchSource:0}: Error finding container 998c84dd177bc429eacd458218d461c515a4f5338690f2d808caa14a639304a4: Status 404 returned error can't find the container with id 998c84dd177bc429eacd458218d461c515a4f5338690f2d808caa14a639304a4 Jun 10 11:20:09.909686 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.909648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" event={"ID":"b955f1f7-500a-4c3b-a532-e951356544d9","Type":"ContainerStarted","Data":"e16c8ac96615e1a8e43d853be0e382e24f72c16c60c7c6ec58465a922245c5ca"} Jun 10 11:20:09.911371 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.911342 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc" exitCode=0 Jun 10 11:20:09.911476 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.911427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc"} Jun 10 11:20:09.911527 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.911495 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"998c84dd177bc429eacd458218d461c515a4f5338690f2d808caa14a639304a4"} Jun 10 11:20:09.913762 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.913740 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"b53e0bf80dca29f29a543bcdc5c0bffe049baabe5f030185a56baefe4d510af6"} Jun 10 11:20:09.913871 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.913808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"8bdc6bd186b94db2628112ed9d18b4343e15126af7829aa91118fd80e663b250"} Jun 10 11:20:09.913871 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.913852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"75d5b0b79c32e118d2b046f58c3adb34252829f4213e2641fa30a641f9bfd2f9"} Jun 10 11:20:09.915380 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.915356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" event={"ID":"902446ec-6df9-421b-a1b3-6a221c9d0f9e","Type":"ContainerStarted","Data":"9e4e9e369b48d4c26f7ceba697f4807ad2a11161256db574b327a1e6fff04558"} Jun 10 11:20:09.915571 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.915548 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:09.920579 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.920546 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" Jun 10 11:20:09.930955 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.930903 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" podStartSLOduration=2.278255206 podStartE2EDuration="5.930882364s" totalImagesPullingTime="3.652627158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:09.930540149 +0000 UTC m=+55.773617065" watchObservedRunningTime="2026-06-10 11:20:09.930882364 +0000 UTC m=+55.773959280" Jun 10 11:20:09.985561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:09.985506 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kdzbh" podStartSLOduration=1.9858397220000001 podStartE2EDuration="4.985485326s" totalImagesPullingTime="2.999645604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:09.984338118 +0000 UTC m=+55.827415056" watchObservedRunningTime="2026-06-10 11:20:09.985485326 +0000 UTC m=+55.828562244" Jun 10 11:20:10.685274 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:10.685235 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:11.931781 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:11.931753 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"53aa50d8c6f5cef5d4263d2ce5a2faf9714632278a76f98a76b5cbc9fccb86dd"} Jun 10 11:20:11.932123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:11.931842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"6b617efd130ae04d20858d0bd032fa1758c0439036fdcf7380baf053e12f12fe"} Jun 10 11:20:11.932123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:11.931887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"576b97c315b683f0c1c5f3d7c68e9d092efac1ea262840b75928554ff85fa9fa"} Jun 10 11:20:11.932123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:11.931929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"15c57041bea58ff7268e18b3ad42a634fb9f66a2237dfaecfc902b25fa12805f"} Jun 10 11:20:11.932123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:11.931968 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"5e4be009169a6f5111eb062f80d349b50be8d4a2fcfbe268473131f608969e29"} Jun 10 11:20:11.934921 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:11.934891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"0bf33eccf4de61ad36a8703d7d4a1d91c07f3be585f01b137456c84553f53ee6"} Jun 10 11:20:12.942915 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:12.942874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerStarted","Data":"3b3c079631ba2978a0a145c21692a085b9998325eb10ea63546c9ee30458d0a6"} Jun 10 11:20:12.946623 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:12.946582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"003727b0d361bd10b9e7fef15745d4092be25afb218fcd54cfc2650db28504f2"} Jun 10 11:20:12.946762 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:12.946659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" event={"ID":"1bb2643a-bbd6-4191-a688-25c7e161ac3e","Type":"ContainerStarted","Data":"684e891c30c86ba9808cdcd1d5896d6227a94f2462bae3c62c3d55268d9059fa"} Jun 10 11:20:12.946830 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:12.946774 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:12.975706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:12.975643 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.896302274 podStartE2EDuration="11.97562254s" totalImagesPullingTime="7.075384059s" totalInitContainerRuntime="3.936207ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:12.973961665 +0000 UTC m=+58.817038619" watchObservedRunningTime="2026-06-10 11:20:12.97562254 +0000 UTC m=+58.818699459" Jun 10 11:20:13.001797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.001728 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" podStartSLOduration=4.921304028 podStartE2EDuration="11.001704247s" totalImagesPullingTime="6.080400219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:13.000104836 +0000 UTC m=+58.843181754" watchObservedRunningTime="2026-06-10 11:20:13.001704247 +0000 UTC m=+58.844781164" Jun 10 11:20:13.953696 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.953598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93"} Jun 10 11:20:13.953696 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.953676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc"} Jun 10 11:20:13.954157 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.953718 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b"} Jun 10 11:20:13.954157 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.953754 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f"} Jun 10 11:20:13.954157 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.953796 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32"} Jun 10 11:20:13.954157 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.953832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerStarted","Data":"9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c"} Jun 10 11:20:13.988365 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:13.987913 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.516126954 podStartE2EDuration="7.987892465s" totalImagesPullingTime="3.450856078s" totalInitContainerRuntime="20.909433ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:13.985309294 +0000 UTC m=+59.828386212" watchObservedRunningTime="2026-06-10 11:20:13.987892465 +0000 UTC m=+59.830969384" Jun 10 11:20:16.505826 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:16.505789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:16.506338 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:16.505891 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:16.510833 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:16.510808 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:16.770452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:16.770380 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfxlt" Jun 10 11:20:16.970060 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:16.970029 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7447898478-495rg" Jun 10 11:20:17.332618 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:17.332579 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:18.959356 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:18.959327 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cfb898f46-g2zs5" Jun 10 11:20:20.311607 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.311547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:20:20.315008 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.314990 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:20:20.324512 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.324483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dac2d1b9-2c4a-4fa1-9879-acff77422884-metrics-certs\") pod \"network-metrics-daemon-p4ktk\" (UID: \"dac2d1b9-2c4a-4fa1-9879-acff77422884\") " pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:20:20.412587 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.412540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:20:20.412791 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.412613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:20:20.415672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.415654 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:20:20.415767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.415697 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:20:20.425359 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.425333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/803f43d5-0da4-4c72-b16f-e1f93933e1dc-original-pull-secret\") pod \"global-pull-secret-syncer-hf5df\" (UID: \"803f43d5-0da4-4c72-b16f-e1f93933e1dc\") " pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:20:20.425777 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.425763 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:20:20.435989 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.435973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5hl\" (UniqueName: \"kubernetes.io/projected/779be0f7-8538-43ee-b819-8132f63fdbfe-kube-api-access-6w5hl\") pod \"network-check-target-5dzcp\" (UID: \"779be0f7-8538-43ee-b819-8132f63fdbfe\") " pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:20:20.506819 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.506788 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqxnp\"" Jun 10 11:20:20.512252 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.512228 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xq8q5\"" Jun 10 11:20:20.513565 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.513547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:20:20.515501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.515481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf5df" Jun 10 11:20:20.519514 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.519497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4ktk" Jun 10 11:20:20.663713 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.663562 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hf5df"] Jun 10 11:20:20.667061 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:20.667028 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803f43d5_0da4_4c72_b16f_e1f93933e1dc.slice/crio-45b39a6b75f9e3939645577704556e5c04e946eae764caf264512159f6bdf6b2 WatchSource:0}: Error finding container 45b39a6b75f9e3939645577704556e5c04e946eae764caf264512159f6bdf6b2: Status 404 returned error can't find the container with id 45b39a6b75f9e3939645577704556e5c04e946eae764caf264512159f6bdf6b2 Jun 10 11:20:20.689683 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.689606 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5dzcp"] Jun 10 11:20:20.692453 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:20.692426 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779be0f7_8538_43ee_b819_8132f63fdbfe.slice/crio-0c8fbfa5743e5e69146d5b21df2295581589d48418945ffe2f90b8f5c9edad93 WatchSource:0}: Error finding container 0c8fbfa5743e5e69146d5b21df2295581589d48418945ffe2f90b8f5c9edad93: Status 404 returned error can't find the container with id 0c8fbfa5743e5e69146d5b21df2295581589d48418945ffe2f90b8f5c9edad93 Jun 10 11:20:20.713034 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.713012 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4ktk"] Jun 10 11:20:20.715593 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:20.715572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac2d1b9_2c4a_4fa1_9879_acff77422884.slice/crio-14778ee74f3dcfb2a58114afa2a7a99889ff3922eaa3048490a17c31756d9c41 WatchSource:0}: Error finding container 14778ee74f3dcfb2a58114afa2a7a99889ff3922eaa3048490a17c31756d9c41: Status 404 returned error can't find the container with id 14778ee74f3dcfb2a58114afa2a7a99889ff3922eaa3048490a17c31756d9c41 Jun 10 11:20:20.983679 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.983646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hf5df" event={"ID":"803f43d5-0da4-4c72-b16f-e1f93933e1dc","Type":"ContainerStarted","Data":"45b39a6b75f9e3939645577704556e5c04e946eae764caf264512159f6bdf6b2"} Jun 10 11:20:20.984931 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.984903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4ktk" event={"ID":"dac2d1b9-2c4a-4fa1-9879-acff77422884","Type":"ContainerStarted","Data":"14778ee74f3dcfb2a58114afa2a7a99889ff3922eaa3048490a17c31756d9c41"} Jun 10 11:20:20.986068 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:20.986048 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5dzcp" event={"ID":"779be0f7-8538-43ee-b819-8132f63fdbfe","Type":"ContainerStarted","Data":"0c8fbfa5743e5e69146d5b21df2295581589d48418945ffe2f90b8f5c9edad93"} Jun 10 11:20:23.004488 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:23.004444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4ktk" event={"ID":"dac2d1b9-2c4a-4fa1-9879-acff77422884","Type":"ContainerStarted","Data":"c3581a83405f083cc700e6e10f805b9d6ec88e3f84e70e6f4858e045673d8572"} Jun 10 11:20:23.004910 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:23.004517 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4ktk" event={"ID":"dac2d1b9-2c4a-4fa1-9879-acff77422884","Type":"ContainerStarted","Data":"7d76b8e490082cbed1c5d13153c78b85f6aabd14d12fb78bbfaeb8efae801f3a"} Jun 10 11:20:23.026050 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:23.025960 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p4ktk" podStartSLOduration=67.843215956 podStartE2EDuration="1m9.025939236s" totalImagesPullingTime="1.18272328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:23.024198702 +0000 UTC m=+68.867275615" watchObservedRunningTime="2026-06-10 11:20:23.025939236 +0000 UTC m=+68.869016155" Jun 10 11:20:25.234026 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:25.233976 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:25.234469 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:25.234070 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:26.018990 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:26.018943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5dzcp" event={"ID":"779be0f7-8538-43ee-b819-8132f63fdbfe","Type":"ContainerStarted","Data":"b514544f5bc25db03cfc457723c394d590dd29668406704915f391aa5f4f24fb"} Jun 10 11:20:26.019208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:26.019043 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:20:26.020471 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:26.020446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hf5df" event={"ID":"803f43d5-0da4-4c72-b16f-e1f93933e1dc","Type":"ContainerStarted","Data":"779675a5e034c2619462fb2b64c5f6f923cc4d814ef006af1e53ad9e67106bc2"} Jun 10 11:20:26.038862 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:26.038815 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5dzcp" podStartSLOduration=67.4280045 podStartE2EDuration="1m12.038801354s" totalImagesPullingTime="4.610796854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:26.038009397 +0000 UTC m=+71.881086315" watchObservedRunningTime="2026-06-10 11:20:26.038801354 +0000 UTC m=+71.881878269" Jun 10 11:20:26.057165 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:26.057117 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hf5df" podStartSLOduration=66.417431513 podStartE2EDuration="1m11.057101511s" totalImagesPullingTime="4.639669998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:26.056071398 +0000 UTC m=+71.899148315" watchObservedRunningTime="2026-06-10 11:20:26.057101511 +0000 UTC m=+71.900178427" Jun 10 11:20:32.923356 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:32.923291 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f5f8fc64b-thzr5" podUID="0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" containerName="console" containerID="cri-o://8a18b0b0e0002f8818b2f2149a91ca11dd7eba185721c4748e1283a903e976cb" gracePeriod=15 Jun 10 11:20:33.050571 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.050539 2563 generic.go:356] "Generic (PLEG): container finished" podID="0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" containerID="8a18b0b0e0002f8818b2f2149a91ca11dd7eba185721c4748e1283a903e976cb" exitCode=0 Jun 10 11:20:33.050725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.050612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f8fc64b-thzr5" event={"ID":"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447","Type":"ContainerDied","Data":"8a18b0b0e0002f8818b2f2149a91ca11dd7eba185721c4748e1283a903e976cb"} Jun 10 11:20:33.177154 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.177090 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:33.229843 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.229812 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-serving-cert\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230033 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.229854 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-oauth-config\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230033 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.229886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-oauth-serving-cert\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230033 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.229911 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-config\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230033 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.229949 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwhq7\" (UniqueName: \"kubernetes.io/projected/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-kube-api-access-nwhq7\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230033 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.229967 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-service-ca\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230033 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.230004 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-trusted-ca-bundle\") pod \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\" (UID: \"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447\") " Jun 10 11:20:33.230461 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.230432 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-config" (OuterVolumeSpecName: "console-config") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:33.230461 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.230442 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-service-ca" (OuterVolumeSpecName: "service-ca") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:33.230620 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.230469 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:33.230620 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.230517 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:33.232218 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.232165 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:33.232588 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.232563 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:33.232671 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.232588 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-kube-api-access-nwhq7" (OuterVolumeSpecName: "kube-api-access-nwhq7") pod "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" (UID: "0cdd1c6e-5c7c-4b6c-8deb-3feee4105447"). InnerVolumeSpecName "kube-api-access-nwhq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:33.330997 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.330953 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwhq7\" (UniqueName: \"kubernetes.io/projected/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-kube-api-access-nwhq7\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:33.330997 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.330989 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-service-ca\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:33.330997 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.331007 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-trusted-ca-bundle\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:33.331248 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.331016 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-serving-cert\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:33.331248 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.331025 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-oauth-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:33.331248 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.331033 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-oauth-serving-cert\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:33.331248 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:33.331061 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447-console-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:34.059946 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:34.059917 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f8fc64b-thzr5" Jun 10 11:20:34.059946 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:34.059925 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f8fc64b-thzr5" event={"ID":"0cdd1c6e-5c7c-4b6c-8deb-3feee4105447","Type":"ContainerDied","Data":"f143a98d67576c672f765e44c07eba035b92745ddfd42afc8d31ab11f1ab6312"} Jun 10 11:20:34.060420 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:34.059989 2563 scope.go:117] "RemoveContainer" containerID="8a18b0b0e0002f8818b2f2149a91ca11dd7eba185721c4748e1283a903e976cb" Jun 10 11:20:34.082037 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:34.082008 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5f8fc64b-thzr5"] Jun 10 11:20:34.086250 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:34.086222 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5f8fc64b-thzr5"] Jun 10 11:20:34.602256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:34.602215 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" path="/var/lib/kubelet/pods/0cdd1c6e-5c7c-4b6c-8deb-3feee4105447/volumes" Jun 10 11:20:38.024764 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:38.024726 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:38.044230 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:38.044192 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:38.092965 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:38.092937 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:45.239856 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:45.239821 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:45.244327 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:45.244301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9c66db8b9-5kd28" Jun 10 11:20:50.996197 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.995054 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:50.996197 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.995725 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="alertmanager" containerID="cri-o://5e4be009169a6f5111eb062f80d349b50be8d4a2fcfbe268473131f608969e29" gracePeriod=120 Jun 10 11:20:50.996197 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.996054 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy" containerID="cri-o://6b617efd130ae04d20858d0bd032fa1758c0439036fdcf7380baf053e12f12fe" gracePeriod=120 Jun 10 11:20:50.996786 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.996271 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="prom-label-proxy" containerID="cri-o://3b3c079631ba2978a0a145c21692a085b9998325eb10ea63546c9ee30458d0a6" gracePeriod=120 Jun 10 11:20:50.996786 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.996319 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-metric" containerID="cri-o://53aa50d8c6f5cef5d4263d2ce5a2faf9714632278a76f98a76b5cbc9fccb86dd" gracePeriod=120 Jun 10 11:20:50.996786 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.996403 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="config-reloader" containerID="cri-o://15c57041bea58ff7268e18b3ad42a634fb9f66a2237dfaecfc902b25fa12805f" gracePeriod=120 Jun 10 11:20:50.997203 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:50.996975 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-web" containerID="cri-o://576b97c315b683f0c1c5f3d7c68e9d092efac1ea262840b75928554ff85fa9fa" gracePeriod=120 Jun 10 11:20:51.146024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.145987 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="3b3c079631ba2978a0a145c21692a085b9998325eb10ea63546c9ee30458d0a6" exitCode=0 Jun 10 11:20:51.146024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146014 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="53aa50d8c6f5cef5d4263d2ce5a2faf9714632278a76f98a76b5cbc9fccb86dd" exitCode=0 Jun 10 11:20:51.146024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146020 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="6b617efd130ae04d20858d0bd032fa1758c0439036fdcf7380baf053e12f12fe" exitCode=0 Jun 10 11:20:51.146024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146026 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="15c57041bea58ff7268e18b3ad42a634fb9f66a2237dfaecfc902b25fa12805f" exitCode=0 Jun 10 11:20:51.146024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146031 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="5e4be009169a6f5111eb062f80d349b50be8d4a2fcfbe268473131f608969e29" exitCode=0 Jun 10 11:20:51.146368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"3b3c079631ba2978a0a145c21692a085b9998325eb10ea63546c9ee30458d0a6"} Jun 10 11:20:51.146368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"53aa50d8c6f5cef5d4263d2ce5a2faf9714632278a76f98a76b5cbc9fccb86dd"} Jun 10 11:20:51.146368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"6b617efd130ae04d20858d0bd032fa1758c0439036fdcf7380baf053e12f12fe"} Jun 10 11:20:51.146368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"15c57041bea58ff7268e18b3ad42a634fb9f66a2237dfaecfc902b25fa12805f"} Jun 10 11:20:51.146368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:51.146208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"5e4be009169a6f5111eb062f80d349b50be8d4a2fcfbe268473131f608969e29"} Jun 10 11:20:52.156127 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.156086 2563 generic.go:356] "Generic (PLEG): container finished" podID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerID="576b97c315b683f0c1c5f3d7c68e9d092efac1ea262840b75928554ff85fa9fa" exitCode=0 Jun 10 11:20:52.156568 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.156155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"576b97c315b683f0c1c5f3d7c68e9d092efac1ea262840b75928554ff85fa9fa"} Jun 10 11:20:52.254759 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.254733 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309469 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-tls-assets\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309524 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309553 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309585 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft5lh\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-kube-api-access-ft5lh\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309617 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-out\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309647 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-cluster-tls-config\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309686 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309727 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-metrics-client-ca\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309762 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309803 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-web-config\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309830 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-main-db\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309861 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.312199 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.309903 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-volume\") pod \"71d126d7-704d-4d17-8ea7-04b99198bc4c\" (UID: \"71d126d7-704d-4d17-8ea7-04b99198bc4c\") " Jun 10 11:20:52.316757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.315524 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:52.316757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.315887 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:52.316757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.315976 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:20:52.322492 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.322453 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-out" (OuterVolumeSpecName: "config-out") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:20:52.322871 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.322817 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-volume" (OuterVolumeSpecName: "config-volume") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.323301 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.323108 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.323419 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.323377 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.324148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.324122 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:52.324511 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.324406 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-kube-api-access-ft5lh" (OuterVolumeSpecName: "kube-api-access-ft5lh") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "kube-api-access-ft5lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:52.324511 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.324484 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.329249 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.328811 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.331048 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.331024 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.340610 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.340559 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-web-config" (OuterVolumeSpecName: "web-config") pod "71d126d7-704d-4d17-8ea7-04b99198bc4c" (UID: "71d126d7-704d-4d17-8ea7-04b99198bc4c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:52.411195 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411153 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411214 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411226 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft5lh\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-kube-api-access-ft5lh\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411237 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-out\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411249 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-cluster-tls-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411258 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411266 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-metrics-client-ca\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411275 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411283 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-web-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411291 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-main-db\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411300 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d126d7-704d-4d17-8ea7-04b99198bc4c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411308 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d126d7-704d-4d17-8ea7-04b99198bc4c-config-volume\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:52.411364 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:52.411316 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d126d7-704d-4d17-8ea7-04b99198bc4c-tls-assets\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:53.162712 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.162683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d126d7-704d-4d17-8ea7-04b99198bc4c","Type":"ContainerDied","Data":"fba0f15839f4774f8ff7d25c02de790ea8c7563e0b9d7eb7553b6c5d18155dc3"} Jun 10 11:20:53.162712 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.162705 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.163153 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.162758 2563 scope.go:117] "RemoveContainer" containerID="3b3c079631ba2978a0a145c21692a085b9998325eb10ea63546c9ee30458d0a6" Jun 10 11:20:53.170440 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.170419 2563 scope.go:117] "RemoveContainer" containerID="53aa50d8c6f5cef5d4263d2ce5a2faf9714632278a76f98a76b5cbc9fccb86dd" Jun 10 11:20:53.177368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.177348 2563 scope.go:117] "RemoveContainer" containerID="6b617efd130ae04d20858d0bd032fa1758c0439036fdcf7380baf053e12f12fe" Jun 10 11:20:53.184810 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.184792 2563 scope.go:117] "RemoveContainer" containerID="576b97c315b683f0c1c5f3d7c68e9d092efac1ea262840b75928554ff85fa9fa" Jun 10 11:20:53.189080 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.189056 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:53.194168 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.194138 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:53.194901 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.194877 2563 scope.go:117] "RemoveContainer" containerID="15c57041bea58ff7268e18b3ad42a634fb9f66a2237dfaecfc902b25fa12805f" Jun 10 11:20:53.202388 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.202367 2563 scope.go:117] "RemoveContainer" containerID="5e4be009169a6f5111eb062f80d349b50be8d4a2fcfbe268473131f608969e29" Jun 10 11:20:53.209852 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.209828 2563 scope.go:117] "RemoveContainer" containerID="abe023831226493971f1f6b2064e2e6c07437e82fc38d956b7f1f37f4184092d" Jun 10 11:20:53.229260 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229230 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:53.229549 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229535 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy" Jun 10 11:20:53.229590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229552 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy" Jun 10 11:20:53.229590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229560 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="prom-label-proxy" Jun 10 11:20:53.229590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229566 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="prom-label-proxy" Jun 10 11:20:53.229590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229573 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="init-config-reloader" Jun 10 11:20:53.229590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229579 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="init-config-reloader" Jun 10 11:20:53.229590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229587 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-web" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229594 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-web" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229608 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="alertmanager" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229613 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="alertmanager" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229619 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-metric" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229624 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-metric" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229633 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="config-reloader" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229638 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="config-reloader" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229644 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" containerName="console" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229650 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" containerName="console" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229696 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="prom-label-proxy" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229703 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="config-reloader" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229709 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-metric" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229716 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy-web" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229723 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="alertmanager" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229728 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" containerName="kube-rbac-proxy" Jun 10 11:20:53.229757 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.229734 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cdd1c6e-5c7c-4b6c-8deb-3feee4105447" containerName="console" Jun 10 11:20:53.236187 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.236149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.239449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239416 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 11:20:53.239449 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239438 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 11:20:53.239644 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239558 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 11:20:53.239644 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 11:20:53.239755 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239561 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 11:20:53.239755 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239558 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vmp6k\"" Jun 10 11:20:53.239755 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239679 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 11:20:53.239872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239795 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 11:20:53.239914 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.239879 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 11:20:53.246215 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.246192 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 11:20:53.258858 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.258827 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:53.320845 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.320797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa29eb02-218d-4f7c-82e4-24fa9212dddf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.320855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.320883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp8md\" (UniqueName: \"kubernetes.io/projected/fa29eb02-218d-4f7c-82e4-24fa9212dddf-kube-api-access-dp8md\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.320919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa29eb02-218d-4f7c-82e4-24fa9212dddf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.320963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.320996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321057 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa29eb02-218d-4f7c-82e4-24fa9212dddf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-web-config\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa29eb02-218d-4f7c-82e4-24fa9212dddf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.321333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.321324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa29eb02-218d-4f7c-82e4-24fa9212dddf-config-out\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.421841 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.421741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa29eb02-218d-4f7c-82e4-24fa9212dddf-config-out\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.421841 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.421788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa29eb02-218d-4f7c-82e4-24fa9212dddf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.421841 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.421813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.421841 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.421828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp8md\" (UniqueName: \"kubernetes.io/projected/fa29eb02-218d-4f7c-82e4-24fa9212dddf-kube-api-access-dp8md\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.421851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa29eb02-218d-4f7c-82e4-24fa9212dddf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.421966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa29eb02-218d-4f7c-82e4-24fa9212dddf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-web-config\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422654 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422654 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa29eb02-218d-4f7c-82e4-24fa9212dddf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422654 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa29eb02-218d-4f7c-82e4-24fa9212dddf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.422801 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.422700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa29eb02-218d-4f7c-82e4-24fa9212dddf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.423648 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.423616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa29eb02-218d-4f7c-82e4-24fa9212dddf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.424652 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.424627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa29eb02-218d-4f7c-82e4-24fa9212dddf-config-out\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.424973 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.424911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.424973 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.424933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.425151 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.425130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa29eb02-218d-4f7c-82e4-24fa9212dddf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.425429 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.425401 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-web-config\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.425725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.425705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.426053 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.426035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.426267 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.426249 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.426989 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.426974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa29eb02-218d-4f7c-82e4-24fa9212dddf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.431809 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.431781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp8md\" (UniqueName: \"kubernetes.io/projected/fa29eb02-218d-4f7c-82e4-24fa9212dddf-kube-api-access-dp8md\") pod \"alertmanager-main-0\" (UID: \"fa29eb02-218d-4f7c-82e4-24fa9212dddf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.546875 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.546833 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:20:53.694899 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:53.694873 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:20:53.697315 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:53.697287 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa29eb02_218d_4f7c_82e4_24fa9212dddf.slice/crio-eca8e7a1ff035cec6253821b2a757c19a774bdece2f6fe8d80e0f9e5a99cf782 WatchSource:0}: Error finding container eca8e7a1ff035cec6253821b2a757c19a774bdece2f6fe8d80e0f9e5a99cf782: Status 404 returned error can't find the container with id eca8e7a1ff035cec6253821b2a757c19a774bdece2f6fe8d80e0f9e5a99cf782 Jun 10 11:20:54.168859 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.168829 2563 generic.go:356] "Generic (PLEG): container finished" podID="fa29eb02-218d-4f7c-82e4-24fa9212dddf" containerID="cac90c86193c06e4ec69e1dff2b46a23825c937b77317cb7fd92afd0c1344670" exitCode=0 Jun 10 11:20:54.169238 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.168897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerDied","Data":"cac90c86193c06e4ec69e1dff2b46a23825c937b77317cb7fd92afd0c1344670"} Jun 10 11:20:54.169238 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.168952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"eca8e7a1ff035cec6253821b2a757c19a774bdece2f6fe8d80e0f9e5a99cf782"} Jun 10 11:20:54.598977 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.598939 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d126d7-704d-4d17-8ea7-04b99198bc4c" path="/var/lib/kubelet/pods/71d126d7-704d-4d17-8ea7-04b99198bc4c/volumes" Jun 10 11:20:54.991236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.991196 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm"] Jun 10 11:20:54.995371 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.995342 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:54.998902 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.998879 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p754t\"" Jun 10 11:20:54.999031 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.998890 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 11:20:54.999031 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.998917 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 11:20:54.999731 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.999707 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 11:20:54.999840 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:54.999821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 11:20:55.000484 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.000464 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 11:20:55.003972 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.003951 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 11:20:55.010476 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.010454 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm"] Jun 10 11:20:55.137154 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-secret-telemeter-client\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-telemeter-client-tls\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-federate-client-tls\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137534 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chl68\" (UniqueName: \"kubernetes.io/projected/0222bd2b-e97a-47af-8898-7b8122cff36c-kube-api-access-chl68\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137534 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-metrics-client-ca\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.137534 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.137475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-serving-certs-ca-bundle\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.179090 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.179046 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"ceeb8e78a861a66fcbf7f0459909ae2137ec67ab24bdbd4389ed4e147a65b9c4"} Jun 10 11:20:55.179573 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.179134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"f057bc78f5aceaa212d9a9b4ea6b7914f3e7de64427846e67274f5fc269b3dac"} Jun 10 11:20:55.179573 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.179197 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"ef976efb16a20e1bd2d9767ba821357d99108c6c067dff67d3b3d929671e1eda"} Jun 10 11:20:55.179573 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.179240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"cb125cfb9a0db663451c8cb0805706d242e684419c198cd3145b228c14d44566"} Jun 10 11:20:55.179573 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.179272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"d5455837d546e8d08698fb433cc76df751d8481316c02085ef523c4b5225de65"} Jun 10 11:20:55.179573 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.179309 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa29eb02-218d-4f7c-82e4-24fa9212dddf","Type":"ContainerStarted","Data":"6c07ea03647d03d1b1dbf5c10b6d39f8ede39734db7f3434f4caac2474610a17"} Jun 10 11:20:55.213566 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.213493 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.199397584 podStartE2EDuration="2.213470728s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.073144ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:55.210357945 +0000 UTC m=+101.053434861" watchObservedRunningTime="2026-06-10 11:20:55.213470728 +0000 UTC m=+101.056547648" Jun 10 11:20:55.238422 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238591 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-secret-telemeter-client\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238591 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-telemeter-client-tls\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238591 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-federate-client-tls\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238591 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238591 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chl68\" (UniqueName: \"kubernetes.io/projected/0222bd2b-e97a-47af-8898-7b8122cff36c-kube-api-access-chl68\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238763 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-metrics-client-ca\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.238763 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.238686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-serving-certs-ca-bundle\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.239680 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.239650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-serving-certs-ca-bundle\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.240545 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.240522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-metrics-client-ca\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.241093 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.241062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0222bd2b-e97a-47af-8898-7b8122cff36c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.241586 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.241536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.241693 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.241672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-federate-client-tls\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.241767 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.241745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-secret-telemeter-client\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.242509 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.242483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0222bd2b-e97a-47af-8898-7b8122cff36c-telemeter-client-tls\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.247794 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.247767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chl68\" (UniqueName: \"kubernetes.io/projected/0222bd2b-e97a-47af-8898-7b8122cff36c-kube-api-access-chl68\") pod \"telemeter-client-7bb7f67b6c-zhcjm\" (UID: \"0222bd2b-e97a-47af-8898-7b8122cff36c\") " pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.305550 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.305514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" Jun 10 11:20:55.323562 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.323369 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:55.324275 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.323770 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="prometheus" containerID="cri-o://9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c" gracePeriod=600 Jun 10 11:20:55.324275 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.324222 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93" gracePeriod=600 Jun 10 11:20:55.324570 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.324342 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy" containerID="cri-o://7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc" gracePeriod=600 Jun 10 11:20:55.324570 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.324449 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-web" containerID="cri-o://961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b" gracePeriod=600 Jun 10 11:20:55.324570 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.324543 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="thanos-sidecar" containerID="cri-o://2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f" gracePeriod=600 Jun 10 11:20:55.324722 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.324635 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="config-reloader" containerID="cri-o://57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32" gracePeriod=600 Jun 10 11:20:55.492243 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:55.492153 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm"] Jun 10 11:20:55.496148 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:55.496109 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0222bd2b_e97a_47af_8898_7b8122cff36c.slice/crio-ac52755304346c315d055e37fddd3acb251d9dec68e19f7144ff9c1babb20739 WatchSource:0}: Error finding container ac52755304346c315d055e37fddd3acb251d9dec68e19f7144ff9c1babb20739: Status 404 returned error can't find the container with id ac52755304346c315d055e37fddd3acb251d9dec68e19f7144ff9c1babb20739 Jun 10 11:20:56.188020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.187984 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93" exitCode=0 Jun 10 11:20:56.188020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188015 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc" exitCode=0 Jun 10 11:20:56.188020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188024 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f" exitCode=0 Jun 10 11:20:56.188020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188031 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32" exitCode=0 Jun 10 11:20:56.188020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188038 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c" exitCode=0 Jun 10 11:20:56.188741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93"} Jun 10 11:20:56.188741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188138 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc"} Jun 10 11:20:56.188741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f"} Jun 10 11:20:56.188741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32"} Jun 10 11:20:56.188741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.188280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c"} Jun 10 11:20:56.189520 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:56.189493 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" event={"ID":"0222bd2b-e97a-47af-8898-7b8122cff36c","Type":"ContainerStarted","Data":"ac52755304346c315d055e37fddd3acb251d9dec68e19f7144ff9c1babb20739"} Jun 10 11:20:57.018903 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.018876 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.026469 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.026446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5dzcp" Jun 10 11:20:57.158834 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.158805 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-metrics-client-ca\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.158979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.158841 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-0\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.158979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.158857 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-1\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.158979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.158884 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-kubelet-serving-ca-bundle\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.158979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.158925 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-serving-certs-ca-bundle\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.158985 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-web-config\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159023 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159069 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-config\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159095 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-grpc-tls\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159125 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-db\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159169 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159218 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-trusted-ca-bundle\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159220 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.159256 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159247 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-kube-rbac-proxy\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159297 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-2\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159332 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-tls-assets\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-tls\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159385 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-thanos-prometheus-http-client-file\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159279 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159425 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-config-out\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159408 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.159672 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159473 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.160077 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159913 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-metrics-client-certs\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.160077 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.159963 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4s2l\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-kube-api-access-r4s2l\") pod \"6811c968-d3d4-46b2-a90e-28a337c3541d\" (UID: \"6811c968-d3d4-46b2-a90e-28a337c3541d\") " Jun 10 11:20:57.160953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160339 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-metrics-client-ca\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.160953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160364 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.160953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160380 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.160953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160394 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.160953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160584 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.161812 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160727 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.161905 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.160947 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:20:57.162075 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.162048 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:20:57.162752 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.162725 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.163319 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.163293 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.163561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.163411 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.163561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.163516 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-config-out" (OuterVolumeSpecName: "config-out") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:20:57.164470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.164428 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.164566 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.164501 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:57.165773 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.165687 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.166026 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.165867 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-config" (OuterVolumeSpecName: "config") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.166097 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.166048 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.166218 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.166191 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-kube-api-access-r4s2l" (OuterVolumeSpecName: "kube-api-access-r4s2l") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "kube-api-access-r4s2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:20:57.166332 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.166305 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.177638 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.177608 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-web-config" (OuterVolumeSpecName: "web-config") pod "6811c968-d3d4-46b2-a90e-28a337c3541d" (UID: "6811c968-d3d4-46b2-a90e-28a337c3541d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:20:57.197394 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.197360 2563 generic.go:356] "Generic (PLEG): container finished" podID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerID="961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b" exitCode=0 Jun 10 11:20:57.197813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.197441 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b"} Jun 10 11:20:57.197813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.197452 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.197813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.197553 2563 scope.go:117] "RemoveContainer" containerID="716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93" Jun 10 11:20:57.197813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.197539 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6811c968-d3d4-46b2-a90e-28a337c3541d","Type":"ContainerDied","Data":"998c84dd177bc429eacd458218d461c515a4f5338690f2d808caa14a639304a4"} Jun 10 11:20:57.199226 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.199195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" event={"ID":"0222bd2b-e97a-47af-8898-7b8122cff36c","Type":"ContainerStarted","Data":"40f1fd0372a77ed8642520a3cd454fa72c0cf4ff5f42ee5120c3047c0eb9ea98"} Jun 10 11:20:57.207895 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.207878 2563 scope.go:117] "RemoveContainer" containerID="7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc" Jun 10 11:20:57.215361 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.215341 2563 scope.go:117] "RemoveContainer" containerID="961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b" Jun 10 11:20:57.222691 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.222663 2563 scope.go:117] "RemoveContainer" containerID="2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f" Jun 10 11:20:57.226149 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.226124 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:57.231433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.231411 2563 scope.go:117] "RemoveContainer" containerID="57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32" Jun 10 11:20:57.237400 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.237310 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:57.243433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.243415 2563 scope.go:117] "RemoveContainer" containerID="9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c" Jun 10 11:20:57.258172 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.258151 2563 scope.go:117] "RemoveContainer" containerID="1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc" Jun 10 11:20:57.261606 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261581 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261606 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261603 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-web-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261614 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261627 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261635 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-grpc-tls\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261643 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-db\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261653 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261662 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261670 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-kube-rbac-proxy\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261678 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6811c968-d3d4-46b2-a90e-28a337c3541d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261687 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-tls-assets\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261695 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261704 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261712 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6811c968-d3d4-46b2-a90e-28a337c3541d-config-out\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261719 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6811c968-d3d4-46b2-a90e-28a337c3541d-secret-metrics-client-certs\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.261744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.261727 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4s2l\" (UniqueName: \"kubernetes.io/projected/6811c968-d3d4-46b2-a90e-28a337c3541d-kube-api-access-r4s2l\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:20:57.272312 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272287 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:57.272601 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272590 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="init-config-reloader" Jun 10 11:20:57.272650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272602 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="init-config-reloader" Jun 10 11:20:57.272650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272615 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy" Jun 10 11:20:57.272650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272621 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy" Jun 10 11:20:57.272650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272631 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-thanos" Jun 10 11:20:57.272650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272637 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-thanos" Jun 10 11:20:57.272650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272647 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="thanos-sidecar" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272654 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="thanos-sidecar" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272664 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="prometheus" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272669 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="prometheus" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272675 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="config-reloader" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272680 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="config-reloader" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272686 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-web" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272691 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-web" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272734 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-thanos" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272743 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272749 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="thanos-sidecar" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272757 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="prometheus" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272764 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="config-reloader" Jun 10 11:20:57.272832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.272769 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" containerName="kube-rbac-proxy-web" Jun 10 11:20:57.273838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.273815 2563 scope.go:117] "RemoveContainer" containerID="716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93" Jun 10 11:20:57.274233 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.274211 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93\": container with ID starting with 716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93 not found: ID does not exist" containerID="716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93" Jun 10 11:20:57.274291 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.274242 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93"} err="failed to get container status \"716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93\": rpc error: code = NotFound desc = could not find container \"716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93\": container with ID starting with 716a7585f7591a03408a6c8732866f3787f0c5fd69a0fcac9b05df8d8229cb93 not found: ID does not exist" Jun 10 11:20:57.274291 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.274281 2563 scope.go:117] "RemoveContainer" containerID="7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc" Jun 10 11:20:57.274561 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.274543 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc\": container with ID starting with 7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc not found: ID does not exist" containerID="7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc" Jun 10 11:20:57.274624 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.274564 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc"} err="failed to get container status \"7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc\": rpc error: code = NotFound desc = could not find container \"7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc\": container with ID starting with 7f696c74733a6421b3a29fb23a225041f1cfa65a69344551e059aa2e89f9c1dc not found: ID does not exist" Jun 10 11:20:57.274624 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.274578 2563 scope.go:117] "RemoveContainer" containerID="961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b" Jun 10 11:20:57.274787 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.274769 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b\": container with ID starting with 961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b not found: ID does not exist" containerID="961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b" Jun 10 11:20:57.274838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.274793 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b"} err="failed to get container status \"961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b\": rpc error: code = NotFound desc = could not find container \"961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b\": container with ID starting with 961f29157b4dc19049e07f8ea7ca168210452cb42f3d64f26394af7a9142a34b not found: ID does not exist" Jun 10 11:20:57.274838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.274805 2563 scope.go:117] "RemoveContainer" containerID="2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f" Jun 10 11:20:57.275051 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.275032 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f\": container with ID starting with 2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f not found: ID does not exist" containerID="2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f" Jun 10 11:20:57.275118 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.275056 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f"} err="failed to get container status \"2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f\": rpc error: code = NotFound desc = could not find container \"2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f\": container with ID starting with 2dc97867fc337b90c0184c18b0c51edaf166d18ddd3e2595f39189ccf1c1a65f not found: ID does not exist" Jun 10 11:20:57.275118 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.275075 2563 scope.go:117] "RemoveContainer" containerID="57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32" Jun 10 11:20:57.275516 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.275391 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32\": container with ID starting with 57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32 not found: ID does not exist" containerID="57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32" Jun 10 11:20:57.275516 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.275423 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32"} err="failed to get container status \"57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32\": rpc error: code = NotFound desc = could not find container \"57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32\": container with ID starting with 57061f6c510fae5cc829329f988e68685db046cd036d7915ad1aac665c9d3c32 not found: ID does not exist" Jun 10 11:20:57.275516 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.275446 2563 scope.go:117] "RemoveContainer" containerID="9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c" Jun 10 11:20:57.275726 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.275705 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c\": container with ID starting with 9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c not found: ID does not exist" containerID="9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c" Jun 10 11:20:57.275781 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.275731 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c"} err="failed to get container status \"9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c\": rpc error: code = NotFound desc = could not find container \"9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c\": container with ID starting with 9119229cd35cb62ca3c63b3b18d6ccbed4679783731f7b786171d761ac81594c not found: ID does not exist" Jun 10 11:20:57.275781 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.275745 2563 scope.go:117] "RemoveContainer" containerID="1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc" Jun 10 11:20:57.276057 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:20:57.276027 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc\": container with ID starting with 1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc not found: ID does not exist" containerID="1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc" Jun 10 11:20:57.276132 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.276058 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc"} err="failed to get container status \"1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc\": rpc error: code = NotFound desc = could not find container \"1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc\": container with ID starting with 1893e8d4caa6aed001197a43f3aeb9701db7f73842e59a7f456b45d49b7059cc not found: ID does not exist" Jun 10 11:20:57.305614 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.305554 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:57.305782 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.305689 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.308761 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.308732 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 11:20:57.308906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.308817 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 11:20:57.308906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.308830 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7d7a8vrdvkukn\"" Jun 10 11:20:57.308906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.308843 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 11:20:57.308906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.308845 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-km9tt\"" Jun 10 11:20:57.309671 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.309649 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 11:20:57.309803 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.309749 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 11:20:57.309803 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.309760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 11:20:57.309927 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.309782 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 11:20:57.309991 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.309926 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 11:20:57.310112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.310096 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 11:20:57.310159 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.310096 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 11:20:57.310291 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.310271 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 11:20:57.310391 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.310324 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 11:20:57.312877 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.312822 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 11:20:57.316952 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.315279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 11:20:57.463553 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463553 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb4611d-1e38-4b71-946b-be86d5846e42-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.463797 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4dg\" (UniqueName: \"kubernetes.io/projected/1bb4611d-1e38-4b71-946b-be86d5846e42-kube-api-access-zk4dg\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb4611d-1e38-4b71-946b-be86d5846e42-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-config\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.463981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.464131 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.464000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb4611d-1e38-4b71-946b-be86d5846e42-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4dg\" (UniqueName: \"kubernetes.io/projected/1bb4611d-1e38-4b71-946b-be86d5846e42-kube-api-access-zk4dg\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb4611d-1e38-4b71-946b-be86d5846e42-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-config\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.565720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.566333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.566333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.566333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.565955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.566333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.566005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.566333 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.566301 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.568456 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.567774 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.568456 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.567871 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.568456 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.568395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb4611d-1e38-4b71-946b-be86d5846e42-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.570379 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.569522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.570379 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.570245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.571028 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.570995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-config\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.571729 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.571700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.571833 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.571736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.571833 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.571824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.571971 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.571946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.572515 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.572455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb4611d-1e38-4b71-946b-be86d5846e42-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.573823 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.573793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.574379 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.574357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.575528 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.575504 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb4611d-1e38-4b71-946b-be86d5846e42-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.576835 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.576813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.577590 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.577570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.577678 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.577572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb4611d-1e38-4b71-946b-be86d5846e42-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.578050 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.578033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4dg\" (UniqueName: \"kubernetes.io/projected/1bb4611d-1e38-4b71-946b-be86d5846e42-kube-api-access-zk4dg\") pod \"prometheus-k8s-0\" (UID: \"1bb4611d-1e38-4b71-946b-be86d5846e42\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.615287 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.615245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:20:57.797630 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:57.797454 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:20:57.799719 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:20:57.799696 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb4611d_1e38_4b71_946b_be86d5846e42.slice/crio-84dd9957c4a227fc59a1be7cebba72ceaf0066cb8607bfea8a95b5ff4448b2c2 WatchSource:0}: Error finding container 84dd9957c4a227fc59a1be7cebba72ceaf0066cb8607bfea8a95b5ff4448b2c2: Status 404 returned error can't find the container with id 84dd9957c4a227fc59a1be7cebba72ceaf0066cb8607bfea8a95b5ff4448b2c2 Jun 10 11:20:58.204888 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.204791 2563 generic.go:356] "Generic (PLEG): container finished" podID="1bb4611d-1e38-4b71-946b-be86d5846e42" containerID="ae1206efd5c2d293e05b12473d32a559ab606e6e4beaa0ea51f0c60dd45b11ef" exitCode=0 Jun 10 11:20:58.205350 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.204884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerDied","Data":"ae1206efd5c2d293e05b12473d32a559ab606e6e4beaa0ea51f0c60dd45b11ef"} Jun 10 11:20:58.205350 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.204950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"84dd9957c4a227fc59a1be7cebba72ceaf0066cb8607bfea8a95b5ff4448b2c2"} Jun 10 11:20:58.207906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.207881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" event={"ID":"0222bd2b-e97a-47af-8898-7b8122cff36c","Type":"ContainerStarted","Data":"f494d92245666543683e2240c4886fcf6046e0648700cb831cd08603b23737b9"} Jun 10 11:20:58.208020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.207928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" event={"ID":"0222bd2b-e97a-47af-8898-7b8122cff36c","Type":"ContainerStarted","Data":"aa992ba830281af357c4004180f8f279e7dd73f797316f478d7d6ff61e725cdc"} Jun 10 11:20:58.279661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.279611 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bb7f67b6c-zhcjm" podStartSLOduration=2.722475046 podStartE2EDuration="4.279593981s" totalImagesPullingTime="1.557118935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:58.278517443 +0000 UTC m=+104.121594371" watchObservedRunningTime="2026-06-10 11:20:58.279593981 +0000 UTC m=+104.122670897" Jun 10 11:20:58.598282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:58.598247 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6811c968-d3d4-46b2-a90e-28a337c3541d" path="/var/lib/kubelet/pods/6811c968-d3d4-46b2-a90e-28a337c3541d/volumes" Jun 10 11:20:59.216569 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.216472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"578b291c4e507e8868289fe8505ed039c33f971defc9e79406f4ad27dcd8e7df"} Jun 10 11:20:59.216569 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.216541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"36c43dfa86f90e02e9edd7a67beb094aade8557a2e166ac1c2ff5de38b1c102f"} Jun 10 11:20:59.216569 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.216572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"e9c0998ca7a70e33907b859617c13ceef82dad0295fa3741e49335ba88810bc9"} Jun 10 11:20:59.217130 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.216596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"2a061bf8e6e0f9ec58c16014e8c07695ea85d5d9c9b00ae8fa462b7a8001869a"} Jun 10 11:20:59.217130 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.216622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"9fd6c4485cdbc8dd234f1a913042e3eb932ee99f5f6cf78c8b28efe27266481c"} Jun 10 11:20:59.217130 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.216646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb4611d-1e38-4b71-946b-be86d5846e42","Type":"ContainerStarted","Data":"e53f4a02e34de61a551d10ebfeaa56cb1e6f942d9fad22adba8301bf7707da07"} Jun 10 11:20:59.262706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:20:59.262636 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.243047673 podStartE2EDuration="2.262608068s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.560395ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:20:59.261307932 +0000 UTC m=+105.104384850" watchObservedRunningTime="2026-06-10 11:20:59.262608068 +0000 UTC m=+105.105684985" Jun 10 11:21:02.616277 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:02.616242 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:21:10.234814 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:10.234774 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7447898478-495rg"] Jun 10 11:21:35.255273 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.255213 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7447898478-495rg" podUID="92b835c3-3984-4943-80b7-9bb0320b2e52" containerName="console" containerID="cri-o://f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377" gracePeriod=15 Jun 10 11:21:35.499753 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.499728 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447898478-495rg" Jun 10 11:21:35.614840 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.614739 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-oauth-config\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.614840 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.614804 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-serving-cert\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.614840 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.614830 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-trusted-ca-bundle\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.615144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.614988 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-service-ca\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.615144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615048 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-oauth-serving-cert\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.615144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615109 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpzzm\" (UniqueName: \"kubernetes.io/projected/92b835c3-3984-4943-80b7-9bb0320b2e52-kube-api-access-lpzzm\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.615336 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615149 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-console-config\") pod \"92b835c3-3984-4943-80b7-9bb0320b2e52\" (UID: \"92b835c3-3984-4943-80b7-9bb0320b2e52\") " Jun 10 11:21:35.615336 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615265 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:21:35.615558 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615540 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-trusted-ca-bundle\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:35.615621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615554 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:21:35.615621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615560 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-service-ca" (OuterVolumeSpecName: "service-ca") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:21:35.615621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.615597 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-console-config" (OuterVolumeSpecName: "console-config") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:21:35.617151 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.617124 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:21:35.617151 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.617144 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b835c3-3984-4943-80b7-9bb0320b2e52-kube-api-access-lpzzm" (OuterVolumeSpecName: "kube-api-access-lpzzm") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "kube-api-access-lpzzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:21:35.617327 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.617213 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92b835c3-3984-4943-80b7-9bb0320b2e52" (UID: "92b835c3-3984-4943-80b7-9bb0320b2e52"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:21:35.716860 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.716820 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-oauth-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:35.716860 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.716860 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92b835c3-3984-4943-80b7-9bb0320b2e52-console-serving-cert\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:35.717074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.716876 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-service-ca\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:35.717074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.716889 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-oauth-serving-cert\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:35.717074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.716902 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpzzm\" (UniqueName: \"kubernetes.io/projected/92b835c3-3984-4943-80b7-9bb0320b2e52-kube-api-access-lpzzm\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:35.717074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:35.716915 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92b835c3-3984-4943-80b7-9bb0320b2e52-console-config\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:21:36.367423 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.367387 2563 generic.go:356] "Generic (PLEG): container finished" podID="92b835c3-3984-4943-80b7-9bb0320b2e52" containerID="f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377" exitCode=0 Jun 10 11:21:36.367812 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.367453 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447898478-495rg" Jun 10 11:21:36.367812 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.367456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447898478-495rg" event={"ID":"92b835c3-3984-4943-80b7-9bb0320b2e52","Type":"ContainerDied","Data":"f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377"} Jun 10 11:21:36.367812 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.367593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447898478-495rg" event={"ID":"92b835c3-3984-4943-80b7-9bb0320b2e52","Type":"ContainerDied","Data":"28f50ac196fc732950d48778223828ac5f1e98540e6ef4db45cb3f87ad602397"} Jun 10 11:21:36.367812 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.367614 2563 scope.go:117] "RemoveContainer" containerID="f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377" Jun 10 11:21:36.376229 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.376209 2563 scope.go:117] "RemoveContainer" containerID="f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377" Jun 10 11:21:36.376482 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:21:36.376464 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377\": container with ID starting with f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377 not found: ID does not exist" containerID="f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377" Jun 10 11:21:36.376526 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.376488 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377"} err="failed to get container status \"f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377\": rpc error: code = NotFound desc = could not find container \"f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377\": container with ID starting with f814f3bb823bba9277c8fc72491b73ebe7f07f0d0be9ba0feaed7cd9a1b16377 not found: ID does not exist" Jun 10 11:21:36.390366 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.390331 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7447898478-495rg"] Jun 10 11:21:36.394745 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.394716 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7447898478-495rg"] Jun 10 11:21:36.597828 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:36.597793 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b835c3-3984-4943-80b7-9bb0320b2e52" path="/var/lib/kubelet/pods/92b835c3-3984-4943-80b7-9bb0320b2e52/volumes" Jun 10 11:21:57.615574 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:57.615535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:21:57.631522 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:57.631493 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:21:58.471733 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:21:58.471705 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:23:55.335518 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.335413 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm"] Jun 10 11:23:55.336107 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.335939 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b835c3-3984-4943-80b7-9bb0320b2e52" containerName="console" Jun 10 11:23:55.336107 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.335960 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b835c3-3984-4943-80b7-9bb0320b2e52" containerName="console" Jun 10 11:23:55.336107 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.336049 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b835c3-3984-4943-80b7-9bb0320b2e52" containerName="console" Jun 10 11:23:55.338966 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.338943 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.341489 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.341467 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 11:23:55.341723 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.341707 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 11:23:55.341832 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.341814 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dnddc\"" Jun 10 11:23:55.349902 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.349881 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm"] Jun 10 11:23:55.428619 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.428581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj8fv\" (UniqueName: \"kubernetes.io/projected/c8add51c-68f9-4aec-ae8a-54e2aa1b1be6-kube-api-access-mj8fv\") pod \"cert-manager-webhook-7dc76cbb94-5jzjm\" (UID: \"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.428619 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.428624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8add51c-68f9-4aec-ae8a-54e2aa1b1be6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5jzjm\" (UID: \"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.529470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.529434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj8fv\" (UniqueName: \"kubernetes.io/projected/c8add51c-68f9-4aec-ae8a-54e2aa1b1be6-kube-api-access-mj8fv\") pod \"cert-manager-webhook-7dc76cbb94-5jzjm\" (UID: \"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.529470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.529474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8add51c-68f9-4aec-ae8a-54e2aa1b1be6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5jzjm\" (UID: \"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.551489 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.551463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8add51c-68f9-4aec-ae8a-54e2aa1b1be6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5jzjm\" (UID: \"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.552942 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.552920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj8fv\" (UniqueName: \"kubernetes.io/projected/c8add51c-68f9-4aec-ae8a-54e2aa1b1be6-kube-api-access-mj8fv\") pod \"cert-manager-webhook-7dc76cbb94-5jzjm\" (UID: \"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.658632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.658535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:23:55.800971 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.800938 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm"] Jun 10 11:23:55.804408 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:23:55.804382 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8add51c_68f9_4aec_ae8a_54e2aa1b1be6.slice/crio-50609213bb7c043915ecee161b1eb7fc5226f41dab131207807169ccd3fc22db WatchSource:0}: Error finding container 50609213bb7c043915ecee161b1eb7fc5226f41dab131207807169ccd3fc22db: Status 404 returned error can't find the container with id 50609213bb7c043915ecee161b1eb7fc5226f41dab131207807169ccd3fc22db Jun 10 11:23:55.909766 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:23:55.909677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" event={"ID":"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6","Type":"ContainerStarted","Data":"50609213bb7c043915ecee161b1eb7fc5226f41dab131207807169ccd3fc22db"} Jun 10 11:24:00.569853 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.569814 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4"] Jun 10 11:24:00.573113 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.573095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.575912 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.575894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-drqww\"" Jun 10 11:24:00.577382 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.577357 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:24:00.577486 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.577356 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 11:24:00.584169 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.584145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4"] Jun 10 11:24:00.674893 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.674846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8krs\" (UniqueName: \"kubernetes.io/projected/cec4b351-b4f8-40f7-919c-58798ffc27a2-kube-api-access-q8krs\") pod \"openshift-lws-operator-fd8ccff4c-rwbd4\" (UID: \"cec4b351-b4f8-40f7-919c-58798ffc27a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.674893 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.674888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cec4b351-b4f8-40f7-919c-58798ffc27a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rwbd4\" (UID: \"cec4b351-b4f8-40f7-919c-58798ffc27a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.775556 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.775505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8krs\" (UniqueName: \"kubernetes.io/projected/cec4b351-b4f8-40f7-919c-58798ffc27a2-kube-api-access-q8krs\") pod \"openshift-lws-operator-fd8ccff4c-rwbd4\" (UID: \"cec4b351-b4f8-40f7-919c-58798ffc27a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.775556 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.775560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cec4b351-b4f8-40f7-919c-58798ffc27a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rwbd4\" (UID: \"cec4b351-b4f8-40f7-919c-58798ffc27a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.775912 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.775893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cec4b351-b4f8-40f7-919c-58798ffc27a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rwbd4\" (UID: \"cec4b351-b4f8-40f7-919c-58798ffc27a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.785744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.785714 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8krs\" (UniqueName: \"kubernetes.io/projected/cec4b351-b4f8-40f7-919c-58798ffc27a2-kube-api-access-q8krs\") pod \"openshift-lws-operator-fd8ccff4c-rwbd4\" (UID: \"cec4b351-b4f8-40f7-919c-58798ffc27a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:00.883362 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:00.883272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" Jun 10 11:24:01.014171 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:01.014145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4"] Jun 10 11:24:01.016863 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:24:01.016831 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcec4b351_b4f8_40f7_919c_58798ffc27a2.slice/crio-e28e83525767b148d2fb50e297760619a11a67db094e8d3d507e1bead1e8b8e4 WatchSource:0}: Error finding container e28e83525767b148d2fb50e297760619a11a67db094e8d3d507e1bead1e8b8e4: Status 404 returned error can't find the container with id e28e83525767b148d2fb50e297760619a11a67db094e8d3d507e1bead1e8b8e4 Jun 10 11:24:01.939765 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:01.939724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" event={"ID":"cec4b351-b4f8-40f7-919c-58798ffc27a2","Type":"ContainerStarted","Data":"e28e83525767b148d2fb50e297760619a11a67db094e8d3d507e1bead1e8b8e4"} Jun 10 11:24:03.950284 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:03.950172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" event={"ID":"cec4b351-b4f8-40f7-919c-58798ffc27a2","Type":"ContainerStarted","Data":"f179541068281579a10fc971ed4566042e33f9399d918affdef904cc725e720b"} Jun 10 11:24:03.970468 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:03.970395 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwbd4" podStartSLOduration=1.33572187 podStartE2EDuration="3.970374886s" totalImagesPullingTime="2.634653016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:03.970068773 +0000 UTC m=+289.813145691" watchObservedRunningTime="2026-06-10 11:24:03.970374886 +0000 UTC m=+289.813451804" Jun 10 11:24:10.981435 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:10.981400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" event={"ID":"c8add51c-68f9-4aec-ae8a-54e2aa1b1be6","Type":"ContainerStarted","Data":"aad031ec9e662b203f1d739dd0989e14669f8e1056d45f5668a77710c3950912"} Jun 10 11:24:10.981875 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:10.981532 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:24:11.001459 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:11.001405 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" podStartSLOduration=1.289789115 podStartE2EDuration="16.001389216s" totalImagesPullingTime="14.711600101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:10.99984771 +0000 UTC m=+296.842924624" watchObservedRunningTime="2026-06-10 11:24:11.001389216 +0000 UTC m=+296.844466133" Jun 10 11:24:14.550946 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:14.550919 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:24:14.552246 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:14.552228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:24:14.559384 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:14.559356 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 11:24:16.988313 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:16.988275 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5jzjm" Jun 10 11:24:24.265377 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.265341 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn"] Jun 10 11:24:24.268724 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.268708 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.271654 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.271627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 11:24:24.271654 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.271652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vltlh\"" Jun 10 11:24:24.271882 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.271758 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 11:24:24.271882 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.271766 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 11:24:24.271882 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.271775 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 11:24:24.273705 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.273684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcfvt\" (UniqueName: \"kubernetes.io/projected/2f9d6202-421e-4133-8d83-c7b7432cc86a-kube-api-access-gcfvt\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.273769 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.273747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f9d6202-421e-4133-8d83-c7b7432cc86a-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.273810 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.273784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f9d6202-421e-4133-8d83-c7b7432cc86a-manifests\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.273851 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.273824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f9d6202-421e-4133-8d83-c7b7432cc86a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.273891 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.273875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f9d6202-421e-4133-8d83-c7b7432cc86a-tmp\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.287360 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.287336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn"] Jun 10 11:24:24.374805 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.374765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f9d6202-421e-4133-8d83-c7b7432cc86a-manifests\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.375011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.374816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f9d6202-421e-4133-8d83-c7b7432cc86a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.375011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.374848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f9d6202-421e-4133-8d83-c7b7432cc86a-tmp\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.375011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.374909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcfvt\" (UniqueName: \"kubernetes.io/projected/2f9d6202-421e-4133-8d83-c7b7432cc86a-kube-api-access-gcfvt\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.375011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.374965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f9d6202-421e-4133-8d83-c7b7432cc86a-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.375276 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.375159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f9d6202-421e-4133-8d83-c7b7432cc86a-manifests\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.377205 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.377148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f9d6202-421e-4133-8d83-c7b7432cc86a-tmp\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.377355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.377339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f9d6202-421e-4133-8d83-c7b7432cc86a-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.377430 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.377412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f9d6202-421e-4133-8d83-c7b7432cc86a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.394272 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.394242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcfvt\" (UniqueName: \"kubernetes.io/projected/2f9d6202-421e-4133-8d83-c7b7432cc86a-kube-api-access-gcfvt\") pod \"opendatahub-operator-controller-manager-cf8c6bd97-g6cdn\" (UID: \"2f9d6202-421e-4133-8d83-c7b7432cc86a\") " pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.579351 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.579264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:24.728004 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.727973 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn"] Jun 10 11:24:24.732117 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:24:24.732086 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9d6202_421e_4133_8d83_c7b7432cc86a.slice/crio-7857b5e75fecaefc204b1e435a53df1dc77c4d0470402cf2c6aea91ad543e2bd WatchSource:0}: Error finding container 7857b5e75fecaefc204b1e435a53df1dc77c4d0470402cf2c6aea91ad543e2bd: Status 404 returned error can't find the container with id 7857b5e75fecaefc204b1e435a53df1dc77c4d0470402cf2c6aea91ad543e2bd Jun 10 11:24:24.733964 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:24.733944 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:24:25.039435 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:25.039398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" event={"ID":"2f9d6202-421e-4133-8d83-c7b7432cc86a","Type":"ContainerStarted","Data":"7857b5e75fecaefc204b1e435a53df1dc77c4d0470402cf2c6aea91ad543e2bd"} Jun 10 11:24:28.056148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:28.056106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" event={"ID":"2f9d6202-421e-4133-8d83-c7b7432cc86a","Type":"ContainerStarted","Data":"daa5e72c30d299261cb2f7990c95710fff131c0e108acd31ffe40c300704ad40"} Jun 10 11:24:29.064227 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:29.064196 2563 generic.go:356] "Generic (PLEG): container finished" podID="2f9d6202-421e-4133-8d83-c7b7432cc86a" containerID="daa5e72c30d299261cb2f7990c95710fff131c0e108acd31ffe40c300704ad40" exitCode=0 Jun 10 11:24:29.064615 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:29.064257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" event={"ID":"2f9d6202-421e-4133-8d83-c7b7432cc86a","Type":"ContainerDied","Data":"daa5e72c30d299261cb2f7990c95710fff131c0e108acd31ffe40c300704ad40"} Jun 10 11:24:30.070355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:30.070322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" event={"ID":"2f9d6202-421e-4133-8d83-c7b7432cc86a","Type":"ContainerStarted","Data":"e30ee3d578c3e7f7e4ce573b343960eb1953b8d8f81e6d3c5f063c2f96501a46"} Jun 10 11:24:30.070728 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:30.070448 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:30.097583 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:30.097533 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" podStartSLOduration=1.870871124 podStartE2EDuration="6.097516889s" totalImagesPullingTime="3.171845291s" totalInitContainerRuntime="1.054800474s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:30.095091534 +0000 UTC m=+315.938168450" watchObservedRunningTime="2026-06-10 11:24:30.097516889 +0000 UTC m=+315.940593804" Jun 10 11:24:41.076216 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:41.076170 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cf8c6bd97-g6cdn" Jun 10 11:24:53.849476 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.849418 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5"] Jun 10 11:24:53.866976 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.866943 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5"] Jun 10 11:24:53.867160 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.867076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:53.870038 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.870013 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rxfg8\"" Jun 10 11:24:53.870231 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.870213 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 11:24:53.871373 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.871355 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 11:24:53.871469 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.871444 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 11:24:53.944195 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.944138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz2xr\" (UniqueName: \"kubernetes.io/projected/951ce83f-d057-4907-b36b-377c08a99d65-kube-api-access-mz2xr\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:53.944375 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.944214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/951ce83f-d057-4907-b36b-377c08a99d65-cert\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:53.944375 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.944248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/951ce83f-d057-4907-b36b-377c08a99d65-metrics-cert\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:53.944375 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:53.944276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/951ce83f-d057-4907-b36b-377c08a99d65-manager-config\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.045724 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.045684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz2xr\" (UniqueName: \"kubernetes.io/projected/951ce83f-d057-4907-b36b-377c08a99d65-kube-api-access-mz2xr\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.045724 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.045728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/951ce83f-d057-4907-b36b-377c08a99d65-cert\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.045976 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.045766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/951ce83f-d057-4907-b36b-377c08a99d65-metrics-cert\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.045976 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.045791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/951ce83f-d057-4907-b36b-377c08a99d65-manager-config\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.046433 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.046411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/951ce83f-d057-4907-b36b-377c08a99d65-manager-config\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.048289 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.048258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/951ce83f-d057-4907-b36b-377c08a99d65-metrics-cert\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.048448 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.048427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/951ce83f-d057-4907-b36b-377c08a99d65-cert\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.071394 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.071364 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz2xr\" (UniqueName: \"kubernetes.io/projected/951ce83f-d057-4907-b36b-377c08a99d65-kube-api-access-mz2xr\") pod \"lws-controller-manager-7665f65bcf-6h2f5\" (UID: \"951ce83f-d057-4907-b36b-377c08a99d65\") " pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.177032 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.176951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:54.316281 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:54.316253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5"] Jun 10 11:24:54.318410 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:24:54.318381 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951ce83f_d057_4907_b36b_377c08a99d65.slice/crio-160169714a5dc3aae875b6bcaafd45e80732a7dd1a1857a0f52a94600160d160 WatchSource:0}: Error finding container 160169714a5dc3aae875b6bcaafd45e80732a7dd1a1857a0f52a94600160d160: Status 404 returned error can't find the container with id 160169714a5dc3aae875b6bcaafd45e80732a7dd1a1857a0f52a94600160d160 Jun 10 11:24:55.183934 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:55.183858 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" event={"ID":"951ce83f-d057-4907-b36b-377c08a99d65","Type":"ContainerStarted","Data":"160169714a5dc3aae875b6bcaafd45e80732a7dd1a1857a0f52a94600160d160"} Jun 10 11:24:56.189645 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:56.189547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" event={"ID":"951ce83f-d057-4907-b36b-377c08a99d65","Type":"ContainerStarted","Data":"90a2c4d9e8b6c79efab76a878ab14f3108d2a4f91c57a5a59630949d584cfc1d"} Jun 10 11:24:56.190019 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:56.189667 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:24:56.248137 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:24:56.248085 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" podStartSLOduration=1.677322984 podStartE2EDuration="3.248068175s" totalImagesPullingTime="1.570745191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:24:56.246392728 +0000 UTC m=+342.089469638" watchObservedRunningTime="2026-06-10 11:24:56.248068175 +0000 UTC m=+342.091145161" Jun 10 11:25:07.195976 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:07.195946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7665f65bcf-6h2f5" Jun 10 11:25:19.404747 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.404712 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6dbdd44544-4n5d2"] Jun 10 11:25:19.410803 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.410776 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.415894 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.415843 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 11:25:19.416035 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.415966 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-b4gpd\"" Jun 10 11:25:19.421134 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.421111 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6dbdd44544-4n5d2"] Jun 10 11:25:19.458032 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.457996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/78289df2-c7df-4580-be55-032222ff7af2-redirect-config\") pod \"dashboard-redirect-6dbdd44544-4n5d2\" (UID: \"78289df2-c7df-4580-be55-032222ff7af2\") " pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.458223 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.458076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wml2\" (UniqueName: \"kubernetes.io/projected/78289df2-c7df-4580-be55-032222ff7af2-kube-api-access-8wml2\") pod \"dashboard-redirect-6dbdd44544-4n5d2\" (UID: \"78289df2-c7df-4580-be55-032222ff7af2\") " pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.558848 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.558809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/78289df2-c7df-4580-be55-032222ff7af2-redirect-config\") pod \"dashboard-redirect-6dbdd44544-4n5d2\" (UID: \"78289df2-c7df-4580-be55-032222ff7af2\") " pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.559039 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.558883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wml2\" (UniqueName: \"kubernetes.io/projected/78289df2-c7df-4580-be55-032222ff7af2-kube-api-access-8wml2\") pod \"dashboard-redirect-6dbdd44544-4n5d2\" (UID: \"78289df2-c7df-4580-be55-032222ff7af2\") " pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.559553 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.559532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/78289df2-c7df-4580-be55-032222ff7af2-redirect-config\") pod \"dashboard-redirect-6dbdd44544-4n5d2\" (UID: \"78289df2-c7df-4580-be55-032222ff7af2\") " pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.570549 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.570528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wml2\" (UniqueName: \"kubernetes.io/projected/78289df2-c7df-4580-be55-032222ff7af2-kube-api-access-8wml2\") pod \"dashboard-redirect-6dbdd44544-4n5d2\" (UID: \"78289df2-c7df-4580-be55-032222ff7af2\") " pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.721138 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.721052 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" Jun 10 11:25:19.892346 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:19.892306 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6dbdd44544-4n5d2"] Jun 10 11:25:19.892975 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:25:19.892948 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78289df2_c7df_4580_be55_032222ff7af2.slice/crio-7349c54c9c74decb43a1b59d0409095a5d523686afaf64f70a96976122fb90cd WatchSource:0}: Error finding container 7349c54c9c74decb43a1b59d0409095a5d523686afaf64f70a96976122fb90cd: Status 404 returned error can't find the container with id 7349c54c9c74decb43a1b59d0409095a5d523686afaf64f70a96976122fb90cd Jun 10 11:25:20.303128 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:20.303074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" event={"ID":"78289df2-c7df-4580-be55-032222ff7af2","Type":"ContainerStarted","Data":"7349c54c9c74decb43a1b59d0409095a5d523686afaf64f70a96976122fb90cd"} Jun 10 11:25:24.326911 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:24.326874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" event={"ID":"78289df2-c7df-4580-be55-032222ff7af2","Type":"ContainerStarted","Data":"84ad905bbb6d7a0e0f8ec532d4afb994aecc16dc2fa066b2aa9cdd57845af5d0"} Jun 10 11:25:24.348064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:24.348013 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6dbdd44544-4n5d2" podStartSLOduration=1.015680749 podStartE2EDuration="5.347997976s" totalImagesPullingTime="4.332317227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:25:24.347086437 +0000 UTC m=+370.190163354" watchObservedRunningTime="2026-06-10 11:25:24.347997976 +0000 UTC m=+370.191074891" Jun 10 11:25:36.213796 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.213766 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn"] Jun 10 11:25:36.217164 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.217146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.220378 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.220354 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 11:25:36.220661 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.220643 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-q5kqh\"" Jun 10 11:25:36.220743 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.220684 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 11:25:36.221705 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.221685 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 11:25:36.233665 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.233642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn"] Jun 10 11:25:36.311267 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311421 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311421 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311421 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvt8\" (UniqueName: \"kubernetes.io/projected/19fbf978-eb70-4730-aff5-f496addbb6cc-kube-api-access-4hvt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311544 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311544 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311544 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbf978-eb70-4730-aff5-f496addbb6cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311544 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.311697 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.311560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.412935 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.412895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.412935 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.412938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413221 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.412955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbf978-eb70-4730-aff5-f496addbb6cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413221 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413221 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413405 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413405 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413518 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413518 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvt8\" (UniqueName: \"kubernetes.io/projected/19fbf978-eb70-4730-aff5-f496addbb6cc-kube-api-access-4hvt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413623 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413722 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413699 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413815 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413815 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19fbf978-eb70-4730-aff5-f496addbb6cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.413927 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.413845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.415227 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.415199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.415530 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.415509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.422355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.422331 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvt8\" (UniqueName: \"kubernetes.io/projected/19fbf978-eb70-4730-aff5-f496addbb6cc-kube-api-access-4hvt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.423089 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.423065 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19fbf978-eb70-4730-aff5-f496addbb6cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795829zn\" (UID: \"19fbf978-eb70-4730-aff5-f496addbb6cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.527594 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.527558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:36.669124 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:36.669088 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn"] Jun 10 11:25:36.672132 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:25:36.672095 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fbf978_eb70_4730_aff5_f496addbb6cc.slice/crio-4e289a10c58d0a2a6e883bc57e9d0296028476b741c65bd7785ee65f256f7cfd WatchSource:0}: Error finding container 4e289a10c58d0a2a6e883bc57e9d0296028476b741c65bd7785ee65f256f7cfd: Status 404 returned error can't find the container with id 4e289a10c58d0a2a6e883bc57e9d0296028476b741c65bd7785ee65f256f7cfd Jun 10 11:25:37.385813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:37.385778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" event={"ID":"19fbf978-eb70-4730-aff5-f496addbb6cc","Type":"ContainerStarted","Data":"4e289a10c58d0a2a6e883bc57e9d0296028476b741c65bd7785ee65f256f7cfd"} Jun 10 11:25:40.759644 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:40.759606 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:25:40.759924 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:40.759680 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:25:40.759924 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:40.759710 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:25:41.407516 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:41.407477 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" event={"ID":"19fbf978-eb70-4730-aff5-f496addbb6cc","Type":"ContainerStarted","Data":"0af45da21973ae9e724cb0c7a5950293fc982d8f58e2cd761901fcb82889fce5"} Jun 10 11:25:41.432556 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:41.432501 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" podStartSLOduration=1.347313389 podStartE2EDuration="5.432485101s" totalImagesPullingTime="4.085171712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:25:41.431763483 +0000 UTC m=+387.274840402" watchObservedRunningTime="2026-06-10 11:25:41.432485101 +0000 UTC m=+387.275562017" Jun 10 11:25:41.528575 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:41.528535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:41.532911 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:41.532882 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:42.411870 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:42.411837 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:42.412787 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:42.412768 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795829zn" Jun 10 11:25:45.015393 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.015363 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gp6gf"] Jun 10 11:25:45.019003 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.018981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:45.024323 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.024297 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 11:25:45.024468 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.024379 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 11:25:45.024576 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.024562 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-56l6g\"" Jun 10 11:25:45.036444 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.036417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gp6gf"] Jun 10 11:25:45.198240 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.198201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmr9l\" (UniqueName: \"kubernetes.io/projected/1d03c725-2489-47c5-b834-4198e3ba014c-kube-api-access-pmr9l\") pod \"kuadrant-operator-catalog-gp6gf\" (UID: \"1d03c725-2489-47c5-b834-4198e3ba014c\") " pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:45.298935 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.298826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmr9l\" (UniqueName: \"kubernetes.io/projected/1d03c725-2489-47c5-b834-4198e3ba014c-kube-api-access-pmr9l\") pod \"kuadrant-operator-catalog-gp6gf\" (UID: \"1d03c725-2489-47c5-b834-4198e3ba014c\") " pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:45.312811 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.312776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmr9l\" (UniqueName: \"kubernetes.io/projected/1d03c725-2489-47c5-b834-4198e3ba014c-kube-api-access-pmr9l\") pod \"kuadrant-operator-catalog-gp6gf\" (UID: \"1d03c725-2489-47c5-b834-4198e3ba014c\") " pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:45.331536 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.331505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:45.358694 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.358661 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gp6gf"] Jun 10 11:25:45.467137 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.467109 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gp6gf"] Jun 10 11:25:45.469484 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:25:45.469456 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d03c725_2489_47c5_b834_4198e3ba014c.slice/crio-6fed45fc1823cef33ad7b823c02306ce49705c920d2e08fb33b0012dd26de3fc WatchSource:0}: Error finding container 6fed45fc1823cef33ad7b823c02306ce49705c920d2e08fb33b0012dd26de3fc: Status 404 returned error can't find the container with id 6fed45fc1823cef33ad7b823c02306ce49705c920d2e08fb33b0012dd26de3fc Jun 10 11:25:45.572240 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.572147 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t6hfm"] Jun 10 11:25:45.576650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.576632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:45.591380 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.591353 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t6hfm"] Jun 10 11:25:45.702397 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.702362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwzrx\" (UniqueName: \"kubernetes.io/projected/ae40a27f-40f1-43e9-bf94-87d4bc122c6d-kube-api-access-qwzrx\") pod \"kuadrant-operator-catalog-t6hfm\" (UID: \"ae40a27f-40f1-43e9-bf94-87d4bc122c6d\") " pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:45.802921 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.802885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwzrx\" (UniqueName: \"kubernetes.io/projected/ae40a27f-40f1-43e9-bf94-87d4bc122c6d-kube-api-access-qwzrx\") pod \"kuadrant-operator-catalog-t6hfm\" (UID: \"ae40a27f-40f1-43e9-bf94-87d4bc122c6d\") " pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:45.813634 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.813609 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwzrx\" (UniqueName: \"kubernetes.io/projected/ae40a27f-40f1-43e9-bf94-87d4bc122c6d-kube-api-access-qwzrx\") pod \"kuadrant-operator-catalog-t6hfm\" (UID: \"ae40a27f-40f1-43e9-bf94-87d4bc122c6d\") " pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:45.885768 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:45.885682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:46.037355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:46.037333 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t6hfm"] Jun 10 11:25:46.039172 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:25:46.039139 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae40a27f_40f1_43e9_bf94_87d4bc122c6d.slice/crio-d64083d15a03b7ada724022b66e4d8fcb08ef5865cef0c210469035f2a3a92e7 WatchSource:0}: Error finding container d64083d15a03b7ada724022b66e4d8fcb08ef5865cef0c210469035f2a3a92e7: Status 404 returned error can't find the container with id d64083d15a03b7ada724022b66e4d8fcb08ef5865cef0c210469035f2a3a92e7 Jun 10 11:25:46.437639 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:46.437604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" event={"ID":"ae40a27f-40f1-43e9-bf94-87d4bc122c6d","Type":"ContainerStarted","Data":"d64083d15a03b7ada724022b66e4d8fcb08ef5865cef0c210469035f2a3a92e7"} Jun 10 11:25:46.439014 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:46.438982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" event={"ID":"1d03c725-2489-47c5-b834-4198e3ba014c","Type":"ContainerStarted","Data":"6fed45fc1823cef33ad7b823c02306ce49705c920d2e08fb33b0012dd26de3fc"} Jun 10 11:25:48.453219 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.453157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" event={"ID":"ae40a27f-40f1-43e9-bf94-87d4bc122c6d","Type":"ContainerStarted","Data":"dcadebecb9223355271dcb53d0fda30ced33a8fa5970f3f0d03794c94fe5acbc"} Jun 10 11:25:48.454619 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.454589 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" event={"ID":"1d03c725-2489-47c5-b834-4198e3ba014c","Type":"ContainerStarted","Data":"bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae"} Jun 10 11:25:48.454739 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.454693 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" podUID="1d03c725-2489-47c5-b834-4198e3ba014c" containerName="registry-server" containerID="cri-o://bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae" gracePeriod=2 Jun 10 11:25:48.475782 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.475736 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" podStartSLOduration=1.981345776 podStartE2EDuration="3.475721539s" totalImagesPullingTime="1.494375763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:25:48.475050846 +0000 UTC m=+394.318127785" watchObservedRunningTime="2026-06-10 11:25:48.475721539 +0000 UTC m=+394.318798456" Jun 10 11:25:48.495594 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.495537 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" podStartSLOduration=2.432371196 podStartE2EDuration="4.49552209s" totalImagesPullingTime="2.063150894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:25:48.495058607 +0000 UTC m=+394.338135524" watchObservedRunningTime="2026-06-10 11:25:48.49552209 +0000 UTC m=+394.338599007" Jun 10 11:25:48.711633 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.711570 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:48.833579 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.833539 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmr9l\" (UniqueName: \"kubernetes.io/projected/1d03c725-2489-47c5-b834-4198e3ba014c-kube-api-access-pmr9l\") pod \"1d03c725-2489-47c5-b834-4198e3ba014c\" (UID: \"1d03c725-2489-47c5-b834-4198e3ba014c\") " Jun 10 11:25:48.835733 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.835709 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d03c725-2489-47c5-b834-4198e3ba014c-kube-api-access-pmr9l" (OuterVolumeSpecName: "kube-api-access-pmr9l") pod "1d03c725-2489-47c5-b834-4198e3ba014c" (UID: "1d03c725-2489-47c5-b834-4198e3ba014c"). InnerVolumeSpecName "kube-api-access-pmr9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:25:48.934366 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:48.934331 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmr9l\" (UniqueName: \"kubernetes.io/projected/1d03c725-2489-47c5-b834-4198e3ba014c-kube-api-access-pmr9l\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:25:49.460470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.460434 2563 generic.go:356] "Generic (PLEG): container finished" podID="1d03c725-2489-47c5-b834-4198e3ba014c" containerID="bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae" exitCode=0 Jun 10 11:25:49.460906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.460496 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" Jun 10 11:25:49.460906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.460519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" event={"ID":"1d03c725-2489-47c5-b834-4198e3ba014c","Type":"ContainerDied","Data":"bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae"} Jun 10 11:25:49.460906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.460572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gp6gf" event={"ID":"1d03c725-2489-47c5-b834-4198e3ba014c","Type":"ContainerDied","Data":"6fed45fc1823cef33ad7b823c02306ce49705c920d2e08fb33b0012dd26de3fc"} Jun 10 11:25:49.460906 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.460592 2563 scope.go:117] "RemoveContainer" containerID="bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae" Jun 10 11:25:49.470000 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.469984 2563 scope.go:117] "RemoveContainer" containerID="bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae" Jun 10 11:25:49.470267 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:25:49.470250 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae\": container with ID starting with bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae not found: ID does not exist" containerID="bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae" Jun 10 11:25:49.470336 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.470273 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae"} err="failed to get container status \"bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae\": rpc error: code = NotFound desc = could not find container \"bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae\": container with ID starting with bfc1c4d22b151f6bc563be8a68b0538d99808b56da1fd3ce819907d1861a08ae not found: ID does not exist" Jun 10 11:25:49.486645 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.486613 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gp6gf"] Jun 10 11:25:49.491916 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:49.491888 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gp6gf"] Jun 10 11:25:50.598520 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:50.598480 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d03c725-2489-47c5-b834-4198e3ba014c" path="/var/lib/kubelet/pods/1d03c725-2489-47c5-b834-4198e3ba014c/volumes" Jun 10 11:25:55.886214 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:55.886154 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:55.886627 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:55.886232 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:55.908723 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:55.908689 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:25:56.516018 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:25:56.515991 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t6hfm" Jun 10 11:26:03.108205 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.104916 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b58b57ff8-fg5r6"] Jun 10 11:26:03.108205 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.105857 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d03c725-2489-47c5-b834-4198e3ba014c" containerName="registry-server" Jun 10 11:26:03.108205 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.105879 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d03c725-2489-47c5-b834-4198e3ba014c" containerName="registry-server" Jun 10 11:26:03.108205 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.106048 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d03c725-2489-47c5-b834-4198e3ba014c" containerName="registry-server" Jun 10 11:26:03.110929 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.110030 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.113397 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.113373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:26:03.113525 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.113398 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:26:03.114632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.114603 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:26:03.114750 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.114652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x9nhm\"" Jun 10 11:26:03.114750 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.114676 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:26:03.114750 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.114736 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:26:03.114995 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.114960 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:26:03.114995 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.114968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:26:03.119542 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.119525 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 11:26:03.122128 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.122106 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b58b57ff8-fg5r6"] Jun 10 11:26:03.159094 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-service-ca\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.159094 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbr2n\" (UniqueName: \"kubernetes.io/projected/ae8e5167-4e0d-4982-8b70-85250e8beac6-kube-api-access-sbr2n\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.159332 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-trusted-ca-bundle\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.159332 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-serving-cert\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.159332 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-config\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.159455 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-oauth-serving-cert\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.159455 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.159364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-oauth-config\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260432 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-config\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-oauth-serving-cert\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-oauth-config\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-service-ca\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbr2n\" (UniqueName: \"kubernetes.io/projected/ae8e5167-4e0d-4982-8b70-85250e8beac6-kube-api-access-sbr2n\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-trusted-ca-bundle\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.260632 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.260567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-serving-cert\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.261279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.261254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-config\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.261400 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.261348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-service-ca\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.261447 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.261392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-oauth-serving-cert\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.261532 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.261515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae8e5167-4e0d-4982-8b70-85250e8beac6-trusted-ca-bundle\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.262922 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.262899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-serving-cert\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.263030 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.263012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae8e5167-4e0d-4982-8b70-85250e8beac6-console-oauth-config\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.270251 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.270230 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbr2n\" (UniqueName: \"kubernetes.io/projected/ae8e5167-4e0d-4982-8b70-85250e8beac6-kube-api-access-sbr2n\") pod \"console-6b58b57ff8-fg5r6\" (UID: \"ae8e5167-4e0d-4982-8b70-85250e8beac6\") " pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.421311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.421215 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:03.563551 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:03.563523 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b58b57ff8-fg5r6"] Jun 10 11:26:03.565553 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:26:03.565519 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8e5167_4e0d_4982_8b70_85250e8beac6.slice/crio-ae3f8ad282ec3466c019abc2c5e9232a00bd91c1fbb065358850ea7667cdf2ef WatchSource:0}: Error finding container ae3f8ad282ec3466c019abc2c5e9232a00bd91c1fbb065358850ea7667cdf2ef: Status 404 returned error can't find the container with id ae3f8ad282ec3466c019abc2c5e9232a00bd91c1fbb065358850ea7667cdf2ef Jun 10 11:26:04.531559 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:04.531521 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b58b57ff8-fg5r6" event={"ID":"ae8e5167-4e0d-4982-8b70-85250e8beac6","Type":"ContainerStarted","Data":"909dd272059ab3f8c5843c10d074ef8825d453344890dd1fc6645acb25c1a1be"} Jun 10 11:26:04.531952 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:04.531581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b58b57ff8-fg5r6" event={"ID":"ae8e5167-4e0d-4982-8b70-85250e8beac6","Type":"ContainerStarted","Data":"ae3f8ad282ec3466c019abc2c5e9232a00bd91c1fbb065358850ea7667cdf2ef"} Jun 10 11:26:04.551805 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:04.551750 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b58b57ff8-fg5r6" podStartSLOduration=1.551732417 podStartE2EDuration="1.551732417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:26:04.550081928 +0000 UTC m=+410.393158846" watchObservedRunningTime="2026-06-10 11:26:04.551732417 +0000 UTC m=+410.394809333" Jun 10 11:26:13.421527 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:13.421490 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:13.422013 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:13.421582 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:13.426417 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:13.426400 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:13.584148 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:13.584121 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b58b57ff8-fg5r6" Jun 10 11:26:17.681958 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.679266 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc"] Jun 10 11:26:17.690572 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.690539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:17.693551 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.693525 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rr864\"" Jun 10 11:26:17.693792 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.693767 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc"] Jun 10 11:26:17.798626 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.798583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rltt2\" (UniqueName: \"kubernetes.io/projected/4696f484-2993-4fcc-891c-89e56ebfd9e6-kube-api-access-rltt2\") pod \"authorino-operator-75cc8d5cb7-kv4gc\" (UID: \"4696f484-2993-4fcc-891c-89e56ebfd9e6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:17.900064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.900030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rltt2\" (UniqueName: \"kubernetes.io/projected/4696f484-2993-4fcc-891c-89e56ebfd9e6-kube-api-access-rltt2\") pod \"authorino-operator-75cc8d5cb7-kv4gc\" (UID: \"4696f484-2993-4fcc-891c-89e56ebfd9e6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:17.918543 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:17.918511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rltt2\" (UniqueName: \"kubernetes.io/projected/4696f484-2993-4fcc-891c-89e56ebfd9e6-kube-api-access-rltt2\") pod \"authorino-operator-75cc8d5cb7-kv4gc\" (UID: \"4696f484-2993-4fcc-891c-89e56ebfd9e6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:18.002392 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:18.002353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:18.142737 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:18.142697 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc"] Jun 10 11:26:18.144567 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:26:18.144541 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4696f484_2993_4fcc_891c_89e56ebfd9e6.slice/crio-719bf1df25ad805bf67aeb8fffe9e86ed7b7afc21fdeba66318e61817d296619 WatchSource:0}: Error finding container 719bf1df25ad805bf67aeb8fffe9e86ed7b7afc21fdeba66318e61817d296619: Status 404 returned error can't find the container with id 719bf1df25ad805bf67aeb8fffe9e86ed7b7afc21fdeba66318e61817d296619 Jun 10 11:26:18.599737 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:18.599703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" event={"ID":"4696f484-2993-4fcc-891c-89e56ebfd9e6","Type":"ContainerStarted","Data":"719bf1df25ad805bf67aeb8fffe9e86ed7b7afc21fdeba66318e61817d296619"} Jun 10 11:26:20.610555 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.610449 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" event={"ID":"4696f484-2993-4fcc-891c-89e56ebfd9e6","Type":"ContainerStarted","Data":"658fd91e6213449aba672f14bbb6cfda8f9d463c4505ea9092edc60f5d9326c4"} Jun 10 11:26:20.610555 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.610547 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:20.630921 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.630865 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" podStartSLOduration=1.4903984829999999 podStartE2EDuration="3.630847838s" totalImagesPullingTime="2.140449355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:26:20.62966254 +0000 UTC m=+426.472739457" watchObservedRunningTime="2026-06-10 11:26:20.630847838 +0000 UTC m=+426.473924753" Jun 10 11:26:20.885582 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.885506 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx"] Jun 10 11:26:20.889063 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.889044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:20.891965 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.891939 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 11:26:20.892092 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.891998 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m57cc\"" Jun 10 11:26:20.903309 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:20.903281 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx"] Jun 10 11:26:21.033858 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:21.033822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc9rz\" (UniqueName: \"kubernetes.io/projected/6236c2fa-44a1-4e3f-8f23-bbf981116464-kube-api-access-tc9rz\") pod \"dns-operator-controller-manager-864dd78c4c-vmxmx\" (UID: \"6236c2fa-44a1-4e3f-8f23-bbf981116464\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:21.134649 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:21.134606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc9rz\" (UniqueName: \"kubernetes.io/projected/6236c2fa-44a1-4e3f-8f23-bbf981116464-kube-api-access-tc9rz\") pod \"dns-operator-controller-manager-864dd78c4c-vmxmx\" (UID: \"6236c2fa-44a1-4e3f-8f23-bbf981116464\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:21.144806 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:21.144736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc9rz\" (UniqueName: \"kubernetes.io/projected/6236c2fa-44a1-4e3f-8f23-bbf981116464-kube-api-access-tc9rz\") pod \"dns-operator-controller-manager-864dd78c4c-vmxmx\" (UID: \"6236c2fa-44a1-4e3f-8f23-bbf981116464\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:21.199014 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:21.198971 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:21.341859 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:21.341834 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx"] Jun 10 11:26:21.344106 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:26:21.344066 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6236c2fa_44a1_4e3f_8f23_bbf981116464.slice/crio-bf209fc2336859f93ace81a59ecd74b36678b3ece5b3a3a261ea4a43a71b37a8 WatchSource:0}: Error finding container bf209fc2336859f93ace81a59ecd74b36678b3ece5b3a3a261ea4a43a71b37a8: Status 404 returned error can't find the container with id bf209fc2336859f93ace81a59ecd74b36678b3ece5b3a3a261ea4a43a71b37a8 Jun 10 11:26:21.617249 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:21.617209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" event={"ID":"6236c2fa-44a1-4e3f-8f23-bbf981116464","Type":"ContainerStarted","Data":"bf209fc2336859f93ace81a59ecd74b36678b3ece5b3a3a261ea4a43a71b37a8"} Jun 10 11:26:23.597064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.597031 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f"] Jun 10 11:26:23.601268 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.601241 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:23.604135 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.604102 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v9bjc\"" Jun 10 11:26:23.612816 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.612652 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f"] Jun 10 11:26:23.757427 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.757383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkqqd\" (UniqueName: \"kubernetes.io/projected/ea262cb4-b2e5-47d4-8066-fd5784017a68-kube-api-access-lkqqd\") pod \"limitador-operator-controller-manager-859d7b78bd-w777f\" (UID: \"ea262cb4-b2e5-47d4-8066-fd5784017a68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:23.858527 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.858440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkqqd\" (UniqueName: \"kubernetes.io/projected/ea262cb4-b2e5-47d4-8066-fd5784017a68-kube-api-access-lkqqd\") pod \"limitador-operator-controller-manager-859d7b78bd-w777f\" (UID: \"ea262cb4-b2e5-47d4-8066-fd5784017a68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:23.869564 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.869534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkqqd\" (UniqueName: \"kubernetes.io/projected/ea262cb4-b2e5-47d4-8066-fd5784017a68-kube-api-access-lkqqd\") pod \"limitador-operator-controller-manager-859d7b78bd-w777f\" (UID: \"ea262cb4-b2e5-47d4-8066-fd5784017a68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:23.915247 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:23.915222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:24.057163 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:24.057135 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f"] Jun 10 11:26:24.059027 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:26:24.058999 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea262cb4_b2e5_47d4_8066_fd5784017a68.slice/crio-3c78239595d93d2a089aec5048df7164aa7074b27d0d6bd1f610a945a994c8fd WatchSource:0}: Error finding container 3c78239595d93d2a089aec5048df7164aa7074b27d0d6bd1f610a945a994c8fd: Status 404 returned error can't find the container with id 3c78239595d93d2a089aec5048df7164aa7074b27d0d6bd1f610a945a994c8fd Jun 10 11:26:24.634127 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:24.634082 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" event={"ID":"6236c2fa-44a1-4e3f-8f23-bbf981116464","Type":"ContainerStarted","Data":"6387e2376854409363538f8241b5a6fb20830712474b1d83fc346eb4d0c3e51c"} Jun 10 11:26:24.634621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:24.634165 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:24.635480 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:24.635456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" event={"ID":"ea262cb4-b2e5-47d4-8066-fd5784017a68","Type":"ContainerStarted","Data":"3c78239595d93d2a089aec5048df7164aa7074b27d0d6bd1f610a945a994c8fd"} Jun 10 11:26:24.662267 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:24.662214 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" podStartSLOduration=2.124470185 podStartE2EDuration="4.662198732s" totalImagesPullingTime="2.537728547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:26:24.660496775 +0000 UTC m=+430.503573684" watchObservedRunningTime="2026-06-10 11:26:24.662198732 +0000 UTC m=+430.505275648" Jun 10 11:26:26.646961 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:26.646925 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" event={"ID":"ea262cb4-b2e5-47d4-8066-fd5784017a68","Type":"ContainerStarted","Data":"c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b"} Jun 10 11:26:26.647393 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:26.647010 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:26.676127 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:26.676067 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" podStartSLOduration=2.087707885 podStartE2EDuration="3.676051619s" totalImagesPullingTime="1.588343734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:26:26.674595202 +0000 UTC m=+432.517672121" watchObservedRunningTime="2026-06-10 11:26:26.676051619 +0000 UTC m=+432.519128594" Jun 10 11:26:31.619691 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:31.619606 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kv4gc" Jun 10 11:26:35.643593 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:35.643560 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vmxmx" Jun 10 11:26:37.653816 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:37.653781 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:47.216462 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.216422 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8"] Jun 10 11:26:47.220423 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.220403 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.223286 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.223269 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k7sjf\"" Jun 10 11:26:47.234701 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.234673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8"] Jun 10 11:26:47.279668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.279631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/48ca5035-b065-412e-98f3-0077ea68b8e6-kube-api-access-hk8wd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.279838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.279742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ca5035-b065-412e-98f3-0077ea68b8e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.381024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.380981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ca5035-b065-412e-98f3-0077ea68b8e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.381235 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.381042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/48ca5035-b065-412e-98f3-0077ea68b8e6-kube-api-access-hk8wd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.381411 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.381392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ca5035-b065-412e-98f3-0077ea68b8e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.391486 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.391458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/48ca5035-b065-412e-98f3-0077ea68b8e6-kube-api-access-hk8wd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.530868 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.530835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:47.676318 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.676288 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8"] Jun 10 11:26:47.678381 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:26:47.678350 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ca5035_b065_412e_98f3_0077ea68b8e6.slice/crio-e0a675497089d40e8571818f5efa62ee77f350cc14062d28acb1209173f19903 WatchSource:0}: Error finding container e0a675497089d40e8571818f5efa62ee77f350cc14062d28acb1209173f19903: Status 404 returned error can't find the container with id e0a675497089d40e8571818f5efa62ee77f350cc14062d28acb1209173f19903 Jun 10 11:26:47.759950 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:47.759916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" event={"ID":"48ca5035-b065-412e-98f3-0077ea68b8e6","Type":"ContainerStarted","Data":"e0a675497089d40e8571818f5efa62ee77f350cc14062d28acb1209173f19903"} Jun 10 11:26:48.101231 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.101167 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8"] Jun 10 11:26:48.108129 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.108094 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8"] Jun 10 11:26:48.138501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.138466 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb"] Jun 10 11:26:48.142343 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.142315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.164855 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.164814 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f"] Jun 10 11:26:48.165424 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.165372 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" containerName="manager" containerID="cri-o://c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b" gracePeriod=2 Jun 10 11:26:48.167663 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.167628 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb"] Jun 10 11:26:48.177938 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.177869 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f"] Jun 10 11:26:48.189112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.188937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63e346fa-4b7b-4fda-8607-b8ad306f960f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j97sb\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.189112 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.189052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nhgp\" (UniqueName: \"kubernetes.io/projected/63e346fa-4b7b-4fda-8607-b8ad306f960f-kube-api-access-2nhgp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j97sb\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.197239 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:48.197122 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w777f\" is forbidden: User \"system:node:ip-10-0-138-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-53.ec2.internal' and this object" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:48.200599 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.200568 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7"] Jun 10 11:26:48.201077 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.201057 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" containerName="manager" Jun 10 11:26:48.201077 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.201078 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" containerName="manager" Jun 10 11:26:48.201294 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.201211 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" containerName="manager" Jun 10 11:26:48.205028 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.205001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:26:48.208649 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:48.208609 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w777f\" is forbidden: User \"system:node:ip-10-0-138-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-53.ec2.internal' and this object" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:48.214769 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.214689 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7"] Jun 10 11:26:48.290570 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.290539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63e346fa-4b7b-4fda-8607-b8ad306f960f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j97sb\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.290983 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.290598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7tpp\" (UniqueName: \"kubernetes.io/projected/e90321b0-3776-4576-a7c2-832fd9521f2c-kube-api-access-d7tpp\") pod \"limitador-operator-controller-manager-859d7b78bd-k8fr7\" (UID: \"e90321b0-3776-4576-a7c2-832fd9521f2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:26:48.290983 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.290675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nhgp\" (UniqueName: \"kubernetes.io/projected/63e346fa-4b7b-4fda-8607-b8ad306f960f-kube-api-access-2nhgp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j97sb\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.291452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.291421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63e346fa-4b7b-4fda-8607-b8ad306f960f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j97sb\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.310546 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.310518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nhgp\" (UniqueName: \"kubernetes.io/projected/63e346fa-4b7b-4fda-8607-b8ad306f960f-kube-api-access-2nhgp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j97sb\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.392319 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.392280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7tpp\" (UniqueName: \"kubernetes.io/projected/e90321b0-3776-4576-a7c2-832fd9521f2c-kube-api-access-d7tpp\") pod \"limitador-operator-controller-manager-859d7b78bd-k8fr7\" (UID: \"e90321b0-3776-4576-a7c2-832fd9521f2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:26:48.412976 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.412941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7tpp\" (UniqueName: \"kubernetes.io/projected/e90321b0-3776-4576-a7c2-832fd9521f2c-kube-api-access-d7tpp\") pod \"limitador-operator-controller-manager-859d7b78bd-k8fr7\" (UID: \"e90321b0-3776-4576-a7c2-832fd9521f2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:26:48.443151 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.443122 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:48.445957 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:48.445922 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w777f\" is forbidden: User \"system:node:ip-10-0-138-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-53.ec2.internal' and this object" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:48.457092 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.457066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:48.493436 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.493398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkqqd\" (UniqueName: \"kubernetes.io/projected/ea262cb4-b2e5-47d4-8066-fd5784017a68-kube-api-access-lkqqd\") pod \"ea262cb4-b2e5-47d4-8066-fd5784017a68\" (UID: \"ea262cb4-b2e5-47d4-8066-fd5784017a68\") " Jun 10 11:26:48.495720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.495685 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea262cb4-b2e5-47d4-8066-fd5784017a68-kube-api-access-lkqqd" (OuterVolumeSpecName: "kube-api-access-lkqqd") pod "ea262cb4-b2e5-47d4-8066-fd5784017a68" (UID: "ea262cb4-b2e5-47d4-8066-fd5784017a68"). InnerVolumeSpecName "kube-api-access-lkqqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:48.549345 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.549306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:26:48.595276 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.595231 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkqqd\" (UniqueName: \"kubernetes.io/projected/ea262cb4-b2e5-47d4-8066-fd5784017a68-kube-api-access-lkqqd\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:26:48.603198 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.603094 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea262cb4-b2e5-47d4-8066-fd5784017a68" path="/var/lib/kubelet/pods/ea262cb4-b2e5-47d4-8066-fd5784017a68/volumes" Jun 10 11:26:48.636326 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.636296 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb"] Jun 10 11:26:48.639425 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:26:48.639385 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e346fa_4b7b_4fda_8607_b8ad306f960f.slice/crio-e301e6b3b321bee64fcc66297dac5ba9d0e2b7f7a5f198988ca34342e607364b WatchSource:0}: Error finding container e301e6b3b321bee64fcc66297dac5ba9d0e2b7f7a5f198988ca34342e607364b: Status 404 returned error can't find the container with id e301e6b3b321bee64fcc66297dac5ba9d0e2b7f7a5f198988ca34342e607364b Jun 10 11:26:48.741229 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.736731 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7"] Jun 10 11:26:48.768993 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.768955 2563 generic.go:356] "Generic (PLEG): container finished" podID="ea262cb4-b2e5-47d4-8066-fd5784017a68" containerID="c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b" exitCode=0 Jun 10 11:26:48.769156 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.769027 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w777f" Jun 10 11:26:48.769156 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.769067 2563 scope.go:117] "RemoveContainer" containerID="c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b" Jun 10 11:26:48.770872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.770835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" event={"ID":"63e346fa-4b7b-4fda-8607-b8ad306f960f","Type":"ContainerStarted","Data":"e301e6b3b321bee64fcc66297dac5ba9d0e2b7f7a5f198988ca34342e607364b"} Jun 10 11:26:48.772446 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.772414 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" event={"ID":"e90321b0-3776-4576-a7c2-832fd9521f2c","Type":"ContainerStarted","Data":"5f9293e57cdeb2de02e164ef9bb0cc371b214866e55e100970548c57f90810cd"} Jun 10 11:26:48.783785 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.783758 2563 scope.go:117] "RemoveContainer" containerID="c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b" Jun 10 11:26:48.784155 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:48.784121 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b\": container with ID starting with c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b not found: ID does not exist" containerID="c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b" Jun 10 11:26:48.784334 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:48.784164 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b"} err="failed to get container status \"c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b\": rpc error: code = NotFound desc = could not find container \"c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b\": container with ID starting with c155ff9c77e8888ef88a113e3799d59032a6e9312a0d21cd484c784f2cb9e27b not found: ID does not exist" Jun 10 11:26:49.783329 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:49.783285 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" event={"ID":"e90321b0-3776-4576-a7c2-832fd9521f2c","Type":"ContainerStarted","Data":"e750cef803fce1f426d4ac1d466e879a9a0786e2aeb60b7462150aeeed5814d7"} Jun 10 11:26:49.783912 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:49.783400 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:26:49.805611 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:49.805540 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" podStartSLOduration=1.8055212919999999 podStartE2EDuration="1.805521292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:26:49.80395057 +0000 UTC m=+455.647027478" watchObservedRunningTime="2026-06-10 11:26:49.805521292 +0000 UTC m=+455.648598208" Jun 10 11:26:51.796251 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:51.796212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" event={"ID":"63e346fa-4b7b-4fda-8607-b8ad306f960f","Type":"ContainerStarted","Data":"7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8"} Jun 10 11:26:51.796727 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:51.796380 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:26:51.797894 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:51.797870 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" containerName="manager" containerID="cri-o://54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360" gracePeriod=2 Jun 10 11:26:51.820688 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:51.820633 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" podStartSLOduration=0.849424377 podStartE2EDuration="3.820616875s" totalImagesPullingTime="2.971192498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:26:51.817443727 +0000 UTC m=+457.660520644" watchObservedRunningTime="2026-06-10 11:26:51.820616875 +0000 UTC m=+457.663693790" Jun 10 11:26:52.044551 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.044526 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:52.046822 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:52.046792 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" is forbidden: User \"system:node:ip-10-0-138-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-53.ec2.internal' and this object" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:52.135453 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.135419 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/48ca5035-b065-412e-98f3-0077ea68b8e6-kube-api-access-hk8wd\") pod \"48ca5035-b065-412e-98f3-0077ea68b8e6\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " Jun 10 11:26:52.135638 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.135617 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ca5035-b065-412e-98f3-0077ea68b8e6-extensions-socket-volume\") pod \"48ca5035-b065-412e-98f3-0077ea68b8e6\" (UID: \"48ca5035-b065-412e-98f3-0077ea68b8e6\") " Jun 10 11:26:52.135872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.135849 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ca5035-b065-412e-98f3-0077ea68b8e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48ca5035-b065-412e-98f3-0077ea68b8e6" (UID: "48ca5035-b065-412e-98f3-0077ea68b8e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:26:52.135949 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.135937 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48ca5035-b065-412e-98f3-0077ea68b8e6-extensions-socket-volume\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:26:52.137546 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.137524 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ca5035-b065-412e-98f3-0077ea68b8e6-kube-api-access-hk8wd" (OuterVolumeSpecName: "kube-api-access-hk8wd") pod "48ca5035-b065-412e-98f3-0077ea68b8e6" (UID: "48ca5035-b065-412e-98f3-0077ea68b8e6"). InnerVolumeSpecName "kube-api-access-hk8wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:26:52.236505 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.236468 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/48ca5035-b065-412e-98f3-0077ea68b8e6-kube-api-access-hk8wd\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:26:52.599410 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.599323 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" path="/var/lib/kubelet/pods/48ca5035-b065-412e-98f3-0077ea68b8e6/volumes" Jun 10 11:26:52.805214 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.805164 2563 generic.go:356] "Generic (PLEG): container finished" podID="48ca5035-b065-412e-98f3-0077ea68b8e6" containerID="54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360" exitCode=2 Jun 10 11:26:52.805764 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.805228 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:52.805764 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.805262 2563 scope.go:117] "RemoveContainer" containerID="54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360" Jun 10 11:26:52.811707 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:52.811679 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" is forbidden: User \"system:node:ip-10-0-138-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-53.ec2.internal' and this object" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:26:52.813788 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.813764 2563 scope.go:117] "RemoveContainer" containerID="54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360" Jun 10 11:26:52.814075 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:52.814056 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360\": container with ID starting with 54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360 not found: ID does not exist" containerID="54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360" Jun 10 11:26:52.814139 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:26:52.814084 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360"} err="failed to get container status \"54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360\": rpc error: code = NotFound desc = could not find container \"54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360\": container with ID starting with 54e238790381e77d8c93f931d2f48041f7ccad491a086e3d527bd6041fcf3360 not found: ID does not exist" Jun 10 11:26:54.597275 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:26:54.597237 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gfhg8\" is forbidden: User \"system:node:ip-10-0-138-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-53.ec2.internal' and this object" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gfhg8" Jun 10 11:27:00.792664 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:00.792634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k8fr7" Jun 10 11:27:02.808006 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:02.807976 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:27:15.340106 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.340076 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb"] Jun 10 11:27:15.340482 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.340307 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" podUID="63e346fa-4b7b-4fda-8607-b8ad306f960f" containerName="manager" containerID="cri-o://7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8" gracePeriod=10 Jun 10 11:27:15.596831 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.596775 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:27:15.756589 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.756552 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nhgp\" (UniqueName: \"kubernetes.io/projected/63e346fa-4b7b-4fda-8607-b8ad306f960f-kube-api-access-2nhgp\") pod \"63e346fa-4b7b-4fda-8607-b8ad306f960f\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " Jun 10 11:27:15.756758 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.756602 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63e346fa-4b7b-4fda-8607-b8ad306f960f-extensions-socket-volume\") pod \"63e346fa-4b7b-4fda-8607-b8ad306f960f\" (UID: \"63e346fa-4b7b-4fda-8607-b8ad306f960f\") " Jun 10 11:27:15.757011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.756987 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e346fa-4b7b-4fda-8607-b8ad306f960f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "63e346fa-4b7b-4fda-8607-b8ad306f960f" (UID: "63e346fa-4b7b-4fda-8607-b8ad306f960f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:27:15.758633 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.758616 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e346fa-4b7b-4fda-8607-b8ad306f960f-kube-api-access-2nhgp" (OuterVolumeSpecName: "kube-api-access-2nhgp") pod "63e346fa-4b7b-4fda-8607-b8ad306f960f" (UID: "63e346fa-4b7b-4fda-8607-b8ad306f960f"). InnerVolumeSpecName "kube-api-access-2nhgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:27:15.857550 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.857454 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nhgp\" (UniqueName: \"kubernetes.io/projected/63e346fa-4b7b-4fda-8607-b8ad306f960f-kube-api-access-2nhgp\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:27:15.857550 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.857491 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63e346fa-4b7b-4fda-8607-b8ad306f960f-extensions-socket-volume\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:27:15.925956 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.925922 2563 generic.go:356] "Generic (PLEG): container finished" podID="63e346fa-4b7b-4fda-8607-b8ad306f960f" containerID="7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8" exitCode=0 Jun 10 11:27:15.926092 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.925971 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" Jun 10 11:27:15.926092 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.926017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" event={"ID":"63e346fa-4b7b-4fda-8607-b8ad306f960f","Type":"ContainerDied","Data":"7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8"} Jun 10 11:27:15.926092 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.926069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb" event={"ID":"63e346fa-4b7b-4fda-8607-b8ad306f960f","Type":"ContainerDied","Data":"e301e6b3b321bee64fcc66297dac5ba9d0e2b7f7a5f198988ca34342e607364b"} Jun 10 11:27:15.926240 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.926096 2563 scope.go:117] "RemoveContainer" containerID="7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8" Jun 10 11:27:15.940337 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.940317 2563 scope.go:117] "RemoveContainer" containerID="7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8" Jun 10 11:27:15.940593 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:27:15.940575 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8\": container with ID starting with 7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8 not found: ID does not exist" containerID="7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8" Jun 10 11:27:15.940646 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.940601 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8"} err="failed to get container status \"7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8\": rpc error: code = NotFound desc = could not find container \"7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8\": container with ID starting with 7ec9c46c83aec323ce88798b27c37722386a98303384e4e9428a4048dbc42bc8 not found: ID does not exist" Jun 10 11:27:15.953597 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.953575 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb"] Jun 10 11:27:15.961638 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:15.961614 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j97sb"] Jun 10 11:27:16.598947 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:16.598914 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e346fa-4b7b-4fda-8607-b8ad306f960f" path="/var/lib/kubelet/pods/63e346fa-4b7b-4fda-8607-b8ad306f960f/volumes" Jun 10 11:27:19.306650 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.306624 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89"] Jun 10 11:27:19.307286 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.307254 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e346fa-4b7b-4fda-8607-b8ad306f960f" containerName="manager" Jun 10 11:27:19.307286 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.307276 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e346fa-4b7b-4fda-8607-b8ad306f960f" containerName="manager" Jun 10 11:27:19.307470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.307297 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" containerName="manager" Jun 10 11:27:19.307470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.307307 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" containerName="manager" Jun 10 11:27:19.307470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.307391 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e346fa-4b7b-4fda-8607-b8ad306f960f" containerName="manager" Jun 10 11:27:19.307470 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.307403 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ca5035-b065-412e-98f3-0077ea68b8e6" containerName="manager" Jun 10 11:27:19.311659 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.311640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.314948 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.314929 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-25gcb\"" Jun 10 11:27:19.323317 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.323295 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89"] Jun 10 11:27:19.381784 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.381748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e635ea1-6db1-474f-afab-201c01383754-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.381943 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.381795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.381943 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.381848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.381943 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.381882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.381943 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.381917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkj4b\" (UniqueName: \"kubernetes.io/projected/2e635ea1-6db1-474f-afab-201c01383754-kube-api-access-rkj4b\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.382311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.381975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e635ea1-6db1-474f-afab-201c01383754-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.382311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.382012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.382311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.382035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.382311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.382076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e635ea1-6db1-474f-afab-201c01383754-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.482802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.482770 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e635ea1-6db1-474f-afab-201c01383754-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.482983 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.482817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.482983 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.482864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.482983 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.482907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.482983 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.482950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkj4b\" (UniqueName: \"kubernetes.io/projected/2e635ea1-6db1-474f-afab-201c01383754-kube-api-access-rkj4b\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483228 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.482996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e635ea1-6db1-474f-afab-201c01383754-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483228 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483228 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483228 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e635ea1-6db1-474f-afab-201c01383754-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483453 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483528 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483501 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483578 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483640 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.483808 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.483788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e635ea1-6db1-474f-afab-201c01383754-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.485296 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.485275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e635ea1-6db1-474f-afab-201c01383754-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.485426 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.485405 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e635ea1-6db1-474f-afab-201c01383754-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.492736 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.492707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkj4b\" (UniqueName: \"kubernetes.io/projected/2e635ea1-6db1-474f-afab-201c01383754-kube-api-access-rkj4b\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.492859 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.492803 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e635ea1-6db1-474f-afab-201c01383754-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mtn89\" (UID: \"2e635ea1-6db1-474f-afab-201c01383754\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.622064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.621968 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:19.758457 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.758429 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89"] Jun 10 11:27:19.760163 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:27:19.760134 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e635ea1_6db1_474f_afab_201c01383754.slice/crio-8183ae1e2e49af03e6e955dcf0ba5ce13a5898cf91a657a3031be8032fb6e3e9 WatchSource:0}: Error finding container 8183ae1e2e49af03e6e955dcf0ba5ce13a5898cf91a657a3031be8032fb6e3e9: Status 404 returned error can't find the container with id 8183ae1e2e49af03e6e955dcf0ba5ce13a5898cf91a657a3031be8032fb6e3e9 Jun 10 11:27:19.762276 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.762238 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:27:19.762368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.762300 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:27:19.762368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.762330 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:27:19.949084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.948989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" event={"ID":"2e635ea1-6db1-474f-afab-201c01383754","Type":"ContainerStarted","Data":"ec62d087a979a03f7b26297861469eed679a83b4473c70731db9aafe37e5b890"} Jun 10 11:27:19.949084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.949057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" event={"ID":"2e635ea1-6db1-474f-afab-201c01383754","Type":"ContainerStarted","Data":"8183ae1e2e49af03e6e955dcf0ba5ce13a5898cf91a657a3031be8032fb6e3e9"} Jun 10 11:27:19.974565 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:19.974511 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" podStartSLOduration=0.974493802 podStartE2EDuration="974.493802ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:27:19.97396463 +0000 UTC m=+485.817041547" watchObservedRunningTime="2026-06-10 11:27:19.974493802 +0000 UTC m=+485.817570718" Jun 10 11:27:20.622955 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:20.622922 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:20.627819 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:20.627791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:20.954631 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:20.954544 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:20.955532 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:20.955515 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:27:34.167094 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.167059 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:27:34.170559 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.170540 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.173958 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.173924 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cz97\"" Jun 10 11:27:34.173958 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.173934 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 11:27:34.188283 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.188256 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:27:34.218550 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.218515 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:27:34.226022 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.225994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de9c9ec5-5628-4d73-8783-f947b8748437-config-file\") pod \"limitador-limitador-54d6d988d5-zzw7d\" (UID: \"de9c9ec5-5628-4d73-8783-f947b8748437\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.226155 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.226033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5ng5\" (UniqueName: \"kubernetes.io/projected/de9c9ec5-5628-4d73-8783-f947b8748437-kube-api-access-c5ng5\") pod \"limitador-limitador-54d6d988d5-zzw7d\" (UID: \"de9c9ec5-5628-4d73-8783-f947b8748437\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.327471 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.327429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de9c9ec5-5628-4d73-8783-f947b8748437-config-file\") pod \"limitador-limitador-54d6d988d5-zzw7d\" (UID: \"de9c9ec5-5628-4d73-8783-f947b8748437\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.327471 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.327470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5ng5\" (UniqueName: \"kubernetes.io/projected/de9c9ec5-5628-4d73-8783-f947b8748437-kube-api-access-c5ng5\") pod \"limitador-limitador-54d6d988d5-zzw7d\" (UID: \"de9c9ec5-5628-4d73-8783-f947b8748437\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.328127 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.328107 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de9c9ec5-5628-4d73-8783-f947b8748437-config-file\") pod \"limitador-limitador-54d6d988d5-zzw7d\" (UID: \"de9c9ec5-5628-4d73-8783-f947b8748437\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.337408 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.337383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5ng5\" (UniqueName: \"kubernetes.io/projected/de9c9ec5-5628-4d73-8783-f947b8748437-kube-api-access-c5ng5\") pod \"limitador-limitador-54d6d988d5-zzw7d\" (UID: \"de9c9ec5-5628-4d73-8783-f947b8748437\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.482340 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.482309 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:34.652022 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:34.651990 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:27:34.655137 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:27:34.655105 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9c9ec5_5628_4d73_8783_f947b8748437.slice/crio-4df5fecda6f648fe6be06efbaf146c1337a45170fac3afdd97ccd9ef054b8eb8 WatchSource:0}: Error finding container 4df5fecda6f648fe6be06efbaf146c1337a45170fac3afdd97ccd9ef054b8eb8: Status 404 returned error can't find the container with id 4df5fecda6f648fe6be06efbaf146c1337a45170fac3afdd97ccd9ef054b8eb8 Jun 10 11:27:35.027549 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:35.027511 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" event={"ID":"de9c9ec5-5628-4d73-8783-f947b8748437","Type":"ContainerStarted","Data":"4df5fecda6f648fe6be06efbaf146c1337a45170fac3afdd97ccd9ef054b8eb8"} Jun 10 11:27:38.044986 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:38.044947 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" event={"ID":"de9c9ec5-5628-4d73-8783-f947b8748437","Type":"ContainerStarted","Data":"fe688d4d1c6b5a790d9f52a9d57468399e3fa16e28ea1097dc357ef891fe8e2f"} Jun 10 11:27:38.045432 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:38.045073 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:27:38.070720 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:38.070662 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" podStartSLOduration=1.540748116 podStartE2EDuration="4.070644559s" totalImagesPullingTime="2.529896443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:27:38.06897933 +0000 UTC m=+503.912056262" watchObservedRunningTime="2026-06-10 11:27:38.070644559 +0000 UTC m=+503.913721520" Jun 10 11:27:49.051520 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:27:49.051482 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zzw7d" Jun 10 11:29:14.587107 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:14.587075 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:29:14.590110 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:14.590089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:29:38.229741 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.229689 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-rk2f2"] Jun 10 11:29:38.233074 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.233055 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:29:38.236066 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.236023 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 11:29:38.236066 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.236054 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6fwc8\"" Jun 10 11:29:38.245963 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.245937 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-rk2f2"] Jun 10 11:29:38.313554 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.313522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:29:38.329430 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.329394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmk8k\" (UniqueName: \"kubernetes.io/projected/06ee845e-99cb-4143-9c19-d4344f12812b-kube-api-access-jmk8k\") pod \"payload-processing-699b6cd6c-rk2f2\" (UID: \"06ee845e-99cb-4143-9c19-d4344f12812b\") " pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:29:38.430460 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.430421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmk8k\" (UniqueName: \"kubernetes.io/projected/06ee845e-99cb-4143-9c19-d4344f12812b-kube-api-access-jmk8k\") pod \"payload-processing-699b6cd6c-rk2f2\" (UID: \"06ee845e-99cb-4143-9c19-d4344f12812b\") " pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:29:38.444284 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.444239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmk8k\" (UniqueName: \"kubernetes.io/projected/06ee845e-99cb-4143-9c19-d4344f12812b-kube-api-access-jmk8k\") pod \"payload-processing-699b6cd6c-rk2f2\" (UID: \"06ee845e-99cb-4143-9c19-d4344f12812b\") " pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:29:38.543729 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.543671 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:29:38.690461 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.690429 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-rk2f2"] Jun 10 11:29:38.692916 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:29:38.692874 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ee845e_99cb_4143_9c19_d4344f12812b.slice/crio-261575db049db04b9388e62bcacd41935c65212182b0c5b9a77552b668b656c2 WatchSource:0}: Error finding container 261575db049db04b9388e62bcacd41935c65212182b0c5b9a77552b668b656c2: Status 404 returned error can't find the container with id 261575db049db04b9388e62bcacd41935c65212182b0c5b9a77552b668b656c2 Jun 10 11:29:38.694946 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:38.694926 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:29:39.663064 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:39.663021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" event={"ID":"06ee845e-99cb-4143-9c19-d4344f12812b","Type":"ContainerStarted","Data":"261575db049db04b9388e62bcacd41935c65212182b0c5b9a77552b668b656c2"} Jun 10 11:29:41.676311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:41.676279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" event={"ID":"06ee845e-99cb-4143-9c19-d4344f12812b","Type":"ContainerStarted","Data":"6af28032eb902b38ca8ded6912bcee115a6f24a64f48864546f52194defd07b5"} Jun 10 11:29:41.676685 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:41.676389 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:29:41.705001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:41.704945 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" podStartSLOduration=0.935468619 podStartE2EDuration="3.704929635s" totalImagesPullingTime="2.769461016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:29:41.70354385 +0000 UTC m=+627.546620777" watchObservedRunningTime="2026-06-10 11:29:41.704929635 +0000 UTC m=+627.548006550" Jun 10 11:29:46.703618 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:46.703585 2563 generic.go:356] "Generic (PLEG): container finished" podID="2e635ea1-6db1-474f-afab-201c01383754" containerID="ec62d087a979a03f7b26297861469eed679a83b4473c70731db9aafe37e5b890" exitCode=0 Jun 10 11:29:46.704056 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:46.703658 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" event={"ID":"2e635ea1-6db1-474f-afab-201c01383754","Type":"ContainerDied","Data":"ec62d087a979a03f7b26297861469eed679a83b4473c70731db9aafe37e5b890"} Jun 10 11:29:46.704125 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:46.704111 2563 scope.go:117] "RemoveContainer" containerID="ec62d087a979a03f7b26297861469eed679a83b4473c70731db9aafe37e5b890" Jun 10 11:29:46.705160 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:46.705131 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:29:46.705245 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:46.705231 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:29:46.705296 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:46.705280 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:29:47.710294 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:47.710257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" event={"ID":"2e635ea1-6db1-474f-afab-201c01383754","Type":"ContainerStarted","Data":"8e595d35cdca46fc2185eae0759f50ba12b4b47d78aa7a2a95952d9900472708"} Jun 10 11:29:48.622340 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:48.622308 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:29:48.623543 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:48.623514 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jun 10 11:29:48.623659 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:48.623582 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" podUID="2e635ea1-6db1-474f-afab-201c01383754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jun 10 11:29:49.622585 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:49.622547 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jun 10 11:29:49.622979 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:49.622617 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" podUID="2e635ea1-6db1-474f-afab-201c01383754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jun 10 11:29:50.622533 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:50.622496 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jun 10 11:29:50.622708 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:50.622564 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" podUID="2e635ea1-6db1-474f-afab-201c01383754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jun 10 11:29:50.955319 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:50.955225 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:29:51.626293 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:51.626262 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:29:51.734321 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:51.734293 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtn89" Jun 10 11:29:52.684611 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:29:52.684579 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-rk2f2" Jun 10 11:30:49.292396 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:30:49.292357 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:31:08.792278 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:08.792236 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:31:24.913023 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:24.912982 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:31:31.669530 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.669486 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn"] Jun 10 11:31:31.674206 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.674161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.677311 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.677282 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mx8rm\"" Jun 10 11:31:31.677519 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.677498 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 11:31:31.678501 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.678478 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 11:31:31.678616 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.678548 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 11:31:31.686003 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.685978 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn"] Jun 10 11:31:31.743329 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.743285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gth5m\" (UniqueName: \"kubernetes.io/projected/20856093-d059-4274-8dee-a17e8f969c0c-kube-api-access-gth5m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.743560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.743349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20856093-d059-4274-8dee-a17e8f969c0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.743560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.743399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.743560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.743441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.743560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.743490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.743560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.743555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.844883 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.844848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gth5m\" (UniqueName: \"kubernetes.io/projected/20856093-d059-4274-8dee-a17e8f969c0c-kube-api-access-gth5m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.844905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20856093-d059-4274-8dee-a17e8f969c0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.844922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.844950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.844990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.845013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845476 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.845449 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845476 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.845468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.845610 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.845514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.847236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.847216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20856093-d059-4274-8dee-a17e8f969c0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.847390 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.847373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20856093-d059-4274-8dee-a17e8f969c0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.854753 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.854727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gth5m\" (UniqueName: \"kubernetes.io/projected/20856093-d059-4274-8dee-a17e8f969c0c-kube-api-access-gth5m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn\" (UID: \"20856093-d059-4274-8dee-a17e8f969c0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:31.986502 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:31.986473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:32.131947 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:32.131922 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn"] Jun 10 11:31:32.133853 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:31:32.133824 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20856093_d059_4274_8dee_a17e8f969c0c.slice/crio-cb148eea1d3fcc723c55caeb3843de624b8bf5f4de23de93871fc74c262a698c WatchSource:0}: Error finding container cb148eea1d3fcc723c55caeb3843de624b8bf5f4de23de93871fc74c262a698c: Status 404 returned error can't find the container with id cb148eea1d3fcc723c55caeb3843de624b8bf5f4de23de93871fc74c262a698c Jun 10 11:31:32.241649 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:32.241557 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" event={"ID":"20856093-d059-4274-8dee-a17e8f969c0c","Type":"ContainerStarted","Data":"cb148eea1d3fcc723c55caeb3843de624b8bf5f4de23de93871fc74c262a698c"} Jun 10 11:31:32.295558 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:32.295520 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:31:36.267397 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:36.267358 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" event={"ID":"20856093-d059-4274-8dee-a17e8f969c0c","Type":"ContainerStarted","Data":"14a1c2647fa2930a5e2cd8e38cfe9b6875014e6a59bf12e5c482c5a9e067b752"} Jun 10 11:31:37.083390 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:31:37.083356 2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20856093_d059_4274_8dee_a17e8f969c0c.slice/crio-14a1c2647fa2930a5e2cd8e38cfe9b6875014e6a59bf12e5c482c5a9e067b752.scope\": RecentStats: unable to find data in memory cache]" Jun 10 11:31:37.273598 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:37.273555 2563 generic.go:356] "Generic (PLEG): container finished" podID="20856093-d059-4274-8dee-a17e8f969c0c" containerID="14a1c2647fa2930a5e2cd8e38cfe9b6875014e6a59bf12e5c482c5a9e067b752" exitCode=0 Jun 10 11:31:37.273966 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:37.273647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" event={"ID":"20856093-d059-4274-8dee-a17e8f969c0c","Type":"ContainerDied","Data":"14a1c2647fa2930a5e2cd8e38cfe9b6875014e6a59bf12e5c482c5a9e067b752"} Jun 10 11:31:39.286367 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:39.286326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" event={"ID":"20856093-d059-4274-8dee-a17e8f969c0c","Type":"ContainerStarted","Data":"4542d59b67bfed784194e50ce4e2cbf48ad8b1a2108736c0d16c1d9973c60eaf"} Jun 10 11:31:39.313111 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:39.313061 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" podStartSLOduration=2.421468077 podStartE2EDuration="8.313044982s" totalImagesPullingTime="4.575289823s" totalInitContainerRuntime="1.316287082s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:31:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:31:39.310970789 +0000 UTC m=+745.154047706" watchObservedRunningTime="2026-06-10 11:31:39.313044982 +0000 UTC m=+745.156121897" Jun 10 11:31:41.987167 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:41.987137 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:41.987608 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:41.987215 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:41.999914 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:41.999878 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:42.314099 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:42.314008 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn" Jun 10 11:31:59.988423 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:31:59.988389 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5"] Jun 10 11:32:00.004882 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.004849 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5"] Jun 10 11:32:00.005037 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.004966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.007815 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.007793 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 11:32:00.131123 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.131077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.131331 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.131227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.131331 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.131322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.131429 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.131366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.131429 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.131420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hqr\" (UniqueName: \"kubernetes.io/projected/8dc76694-08a3-48e2-a4ec-2740c9de798a-kube-api-access-62hqr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.131506 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.131470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dc76694-08a3-48e2-a4ec-2740c9de798a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.231995 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.231955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dc76694-08a3-48e2-a4ec-2740c9de798a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232224 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232224 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232224 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232224 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232446 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hqr\" (UniqueName: \"kubernetes.io/projected/8dc76694-08a3-48e2-a4ec-2740c9de798a-kube-api-access-62hqr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232541 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232595 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.232677 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.232659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.234345 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.234326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dc76694-08a3-48e2-a4ec-2740c9de798a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.234631 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.234612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dc76694-08a3-48e2-a4ec-2740c9de798a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.240679 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.240624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hqr\" (UniqueName: \"kubernetes.io/projected/8dc76694-08a3-48e2-a4ec-2740c9de798a-kube-api-access-62hqr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5\" (UID: \"8dc76694-08a3-48e2-a4ec-2740c9de798a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.315538 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.315508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:00.451067 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.451033 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5"] Jun 10 11:32:00.454530 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:32:00.454499 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc76694_08a3_48e2_a4ec_2740c9de798a.slice/crio-937c3b1c6137bc74fa15cbb15ed7b3d6f7b07d4cdefca7f5178130fb6a438454 WatchSource:0}: Error finding container 937c3b1c6137bc74fa15cbb15ed7b3d6f7b07d4cdefca7f5178130fb6a438454: Status 404 returned error can't find the container with id 937c3b1c6137bc74fa15cbb15ed7b3d6f7b07d4cdefca7f5178130fb6a438454 Jun 10 11:32:00.792920 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:00.792835 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:32:01.408996 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:01.408957 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" event={"ID":"8dc76694-08a3-48e2-a4ec-2740c9de798a","Type":"ContainerStarted","Data":"7e2ef816cf9803c4cd2c7c3d9c4ea4bdf10b6fd4d2e009c40ddf2818d9f579d0"} Jun 10 11:32:01.409357 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:01.409034 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" event={"ID":"8dc76694-08a3-48e2-a4ec-2740c9de798a","Type":"ContainerStarted","Data":"937c3b1c6137bc74fa15cbb15ed7b3d6f7b07d4cdefca7f5178130fb6a438454"} Jun 10 11:32:02.415527 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:02.415490 2563 generic.go:356] "Generic (PLEG): container finished" podID="8dc76694-08a3-48e2-a4ec-2740c9de798a" containerID="7e2ef816cf9803c4cd2c7c3d9c4ea4bdf10b6fd4d2e009c40ddf2818d9f579d0" exitCode=0 Jun 10 11:32:02.415918 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:02.415548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" event={"ID":"8dc76694-08a3-48e2-a4ec-2740c9de798a","Type":"ContainerDied","Data":"7e2ef816cf9803c4cd2c7c3d9c4ea4bdf10b6fd4d2e009c40ddf2818d9f579d0"} Jun 10 11:32:03.422162 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:03.422132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" event={"ID":"8dc76694-08a3-48e2-a4ec-2740c9de798a","Type":"ContainerStarted","Data":"97e123e0590096f844d6b857aae120a36e93def50776f4209cf2e83debd5b148"} Jun 10 11:32:03.445875 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:03.445826 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" podStartSLOduration=2.965343694 podStartE2EDuration="4.445810209s" totalImagesPullingTime="250.815839ms" totalInitContainerRuntime="1.229650676s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:32:03.44429866 +0000 UTC m=+769.287375586" watchObservedRunningTime="2026-06-10 11:32:03.445810209 +0000 UTC m=+769.288887166" Jun 10 11:32:04.273705 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.273672 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm"] Jun 10 11:32:04.277381 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.277365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.280339 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.280313 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 11:32:04.289639 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.289612 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm"] Jun 10 11:32:04.374819 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.374781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.375001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.374843 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzp6b\" (UniqueName: \"kubernetes.io/projected/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-kube-api-access-nzp6b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.375001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.374896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.375001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.374983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.375168 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.375009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.375168 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.375028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476147 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzp6b\" (UniqueName: \"kubernetes.io/projected/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-kube-api-access-nzp6b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476952 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.476952 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.476720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.478391 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.478369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.478723 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.478706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.486050 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.486031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzp6b\" (UniqueName: \"kubernetes.io/projected/359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1-kube-api-access-nzp6b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nwldm\" (UID: \"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.588343 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.588264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:04.720706 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:04.720683 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm"] Jun 10 11:32:04.722793 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:32:04.722767 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359f1bd6_01dd_4d24_9ba6_18ea4f1f78a1.slice/crio-1778470055c72e24586da64a5e2985cd49585bc695ecc47accae5bc63808eb90 WatchSource:0}: Error finding container 1778470055c72e24586da64a5e2985cd49585bc695ecc47accae5bc63808eb90: Status 404 returned error can't find the container with id 1778470055c72e24586da64a5e2985cd49585bc695ecc47accae5bc63808eb90 Jun 10 11:32:05.192312 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:05.192274 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:32:05.434277 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:05.434243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" event={"ID":"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1","Type":"ContainerStarted","Data":"d885e7123d66bb48762ab8746d4e448e87222aaec29c09dde1b024c2a7f352af"} Jun 10 11:32:05.434277 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:05.434288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" event={"ID":"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1","Type":"ContainerStarted","Data":"1778470055c72e24586da64a5e2985cd49585bc695ecc47accae5bc63808eb90"} Jun 10 11:32:10.316452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:10.316416 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:10.316894 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:10.316477 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:10.328919 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:10.328891 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:10.470699 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:10.470669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5" Jun 10 11:32:11.466542 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:11.466508 2563 generic.go:356] "Generic (PLEG): container finished" podID="359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1" containerID="d885e7123d66bb48762ab8746d4e448e87222aaec29c09dde1b024c2a7f352af" exitCode=0 Jun 10 11:32:11.466937 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:11.466579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" event={"ID":"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1","Type":"ContainerDied","Data":"d885e7123d66bb48762ab8746d4e448e87222aaec29c09dde1b024c2a7f352af"} Jun 10 11:32:12.473899 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:12.473864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" event={"ID":"359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1","Type":"ContainerStarted","Data":"6c507a388ac83bf2db244f43cb900878c3f901ff389a7a41efbe87895dc4ea64"} Jun 10 11:32:12.499581 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:12.499528 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" podStartSLOduration=2.39758643 podStartE2EDuration="8.499513029s" totalImagesPullingTime="195.552472ms" totalInitContainerRuntime="5.906374127s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:32:12.498327963 +0000 UTC m=+778.341404877" watchObservedRunningTime="2026-06-10 11:32:12.499513029 +0000 UTC m=+778.342589945" Jun 10 11:32:14.588617 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:14.588584 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:14.588988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:14.588639 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:14.602128 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:14.602103 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:32:15.500508 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:32:15.500481 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nwldm" Jun 10 11:33:48.192153 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:33:48.192115 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:33:51.887368 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:33:51.887331 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:33:59.593744 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:33:59.593709 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:34:09.201675 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:09.201635 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:34:14.629069 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:14.629040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:34:14.630525 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:14.630503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:34:18.909096 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:18.909058 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:34:29.092671 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:29.092632 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:34:38.096733 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:38.096694 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:34:47.995800 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:34:47.995758 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:35:21.800679 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:35:21.800640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:35:24.888873 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:35:24.888840 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:35:30.478262 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:35:30.478172 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:35:33.085421 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:35:33.085386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:36:01.886860 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:36:01.886823 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:36:18.106865 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:36:18.106827 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:36:56.689521 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:36:56.689491 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:37:13.986279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:37:13.986199 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:37:28.001018 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:37:28.000980 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:37:44.079747 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:37:44.079707 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:38:24.288922 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:38:24.288886 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:38:27.388391 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:38:27.388347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:38:49.797360 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:38:49.797315 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:38:58.891319 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:38:58.891280 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:39:14.663695 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:39:14.663666 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:39:14.673266 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:39:14.673206 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:39:15.493713 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:39:15.493676 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:39:24.281054 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:39:24.281015 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:39:41.121091 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:39:41.121057 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:39:49.591629 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:39:49.591589 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:40:22.383073 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:40:22.382984 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:40:31.182953 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:40:31.182914 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:40:39.589253 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:40:39.589206 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:40:47.686088 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:40:47.686045 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:40:56.076479 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:40:56.076441 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:41:04.196659 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:41:04.196619 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:41:07.284520 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:41:07.284478 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:41:13.092084 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:41:13.092045 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:41:24.600014 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:41:24.599979 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:02.577483 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:02.577447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:04.796526 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:04.796494 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:12.817376 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:12.817337 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:16.393971 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:16.393908 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:24.283089 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:24.283052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:31.995652 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:31.995613 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:41.986662 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:41.986622 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:49.789406 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:49.789366 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:42:58.795187 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:42:58.795137 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:02.281964 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:02.281879 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:07.586218 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:07.586168 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:16.988850 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:16.988817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:25.099144 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:25.099107 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:34.883236 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:34.883201 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:43.107870 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:43.107829 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:52.589922 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:52.589877 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:43:59.982698 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:43:59.982657 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:44:09.588701 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:44:09.588666 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:44:14.703780 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:44:14.703754 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:44:14.716019 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:44:14.715997 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:44:16.992803 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:44:16.992768 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:44:26.791900 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:44:26.791865 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:44:34.884387 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:44:34.884347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:45:20.180358 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:45:20.180325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:45:22.888423 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:45:22.888384 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:46:56.510649 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:46:56.510608 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:47:01.193400 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:47:01.193365 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:47:26.185638 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:47:26.185599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:47:30.989141 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:47:30.989054 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:47:40.291078 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:47:40.291039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:47:50.984326 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:47:50.984289 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:47:59.597914 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:47:59.597880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:48:10.880918 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:48:10.880879 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:48:19.088816 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:48:19.088778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:48:29.590023 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:48:29.589988 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:48:38.482891 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:48:38.482857 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:48:48.989488 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:48:48.989449 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:48:58.298578 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:48:58.298537 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:49:02.396698 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:49:02.396611 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:49:14.737473 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:49:14.737445 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:49:14.749520 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:49:14.749494 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:49:30.887901 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:49:30.887862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:50:13.898567 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:50:13.898529 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:50:22.814583 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:50:22.814543 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:50:31.190624 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:50:31.190538 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:50:39.692507 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:50:39.692467 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:50:48.484001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:50:48.483965 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:50:59.483041 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:50:59.482992 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:51:08.386070 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:51:08.386029 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:51:13.593894 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:51:13.593858 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:51:22.600248 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:51:22.600217 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:51:30.783070 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:51:30.783031 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:51:39.382916 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:51:39.382876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:51:49.787667 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:51:49.787624 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:52:07.706320 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:52:07.706229 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:52:16.194555 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:52:16.194519 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:52:25.113302 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:52:25.113260 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:52:33.189930 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:52:33.189892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:52:50.611882 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:52:50.611845 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:52:59.305149 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:52:59.305114 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:07.715020 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:07.714974 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:16.110482 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:16.110444 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:25.434314 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:25.434277 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:34.075169 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:34.075135 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:42.720579 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:42.720540 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:46.226710 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:46.226672 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:53:56.452987 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:53:56.452950 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:54:05.670599 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:05.670566 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:54:14.772738 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:14.772713 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:54:14.785604 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:14.785583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfxlt_6a2b3e13-335f-4784-8785-1db586f6c5f1/ovn-acl-logging/0.log" Jun 10 11:54:17.237452 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:17.237397 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:54:26.599385 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:26.599350 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:54:34.038411 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:34.038361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:54:43.366104 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:43.366068 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:54:49.316640 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:54:49.316597 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:55:05.546191 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:05.546092 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:55:14.447769 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:14.447730 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zzw7d"] Jun 10 11:55:23.458583 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.458552 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj"] Jun 10 11:55:23.461161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.461139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.465158 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.465134 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1c7082b3-openshift-default-dockercfg-rjd48\"" Jun 10 11:55:23.504053 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-certs\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504239 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwsxt\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-kube-api-access-rwsxt\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504239 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-credential-socket\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504239 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-socket\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504239 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-envoy\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504239 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-token\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504439 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-podinfo\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504439 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-data\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.504439 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.504349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istiod-ca-cert\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.557561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.557525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj"] Jun 10 11:55:23.609301 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-podinfo\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609500 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-data\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609500 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istiod-ca-cert\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609500 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-certs\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609657 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwsxt\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-kube-api-access-rwsxt\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609657 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-credential-socket\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609657 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-socket\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609657 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-envoy\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.609848 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.609675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-token\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.613191 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.613151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-certs\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.613674 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.613652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-data\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.613793 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.613733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-socket\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.613793 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.613755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-credential-socket\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.613902 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.613884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istiod-ca-cert\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.614630 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.614605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-podinfo\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.615872 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.615835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-envoy\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.624436 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.624416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwsxt\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-kube-api-access-rwsxt\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.626563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.626544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-token\") pod \"e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.772275 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.772243 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:23.935725 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.935698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj"] Jun 10 11:55:23.938420 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:55:23.938386 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7eb4e0_83a4_46ac_9d13_a6e2200f5482.slice/crio-fe1280c1e3654c02aadb1bc6fcc5050b33db62195b95d19a9b1d890d58dfe827 WatchSource:0}: Error finding container fe1280c1e3654c02aadb1bc6fcc5050b33db62195b95d19a9b1d890d58dfe827: Status 404 returned error can't find the container with id fe1280c1e3654c02aadb1bc6fcc5050b33db62195b95d19a9b1d890d58dfe827 Jun 10 11:55:23.940825 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.940789 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:55:23.940935 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.940860 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:55:23.940935 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:23.940900 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:55:24.823853 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:24.823817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" event={"ID":"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482","Type":"ContainerStarted","Data":"f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834"} Jun 10 11:55:24.824377 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:24.823870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" event={"ID":"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482","Type":"ContainerStarted","Data":"fe1280c1e3654c02aadb1bc6fcc5050b33db62195b95d19a9b1d890d58dfe827"} Jun 10 11:55:24.901232 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:24.901162 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" podStartSLOduration=1.9011450600000002 podStartE2EDuration="1.90114506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:55:24.899145985 +0000 UTC m=+2170.742222900" watchObservedRunningTime="2026-06-10 11:55:24.90114506 +0000 UTC m=+2170.744221975" Jun 10 11:55:25.772482 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:25.772439 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:25.778004 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:25.777975 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:25.829316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:25.829286 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:25.830316 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:25.830296 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:30.041337 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:30.041302 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj"] Jun 10 11:55:30.041785 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:30.041493 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" podUID="0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" containerName="istio-proxy" containerID="cri-o://f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834" gracePeriod=30 Jun 10 11:55:35.291828 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.291803 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:35.429077 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.428968 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istiod-ca-cert\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429077 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429050 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-envoy\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429352 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429108 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwsxt\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-kube-api-access-rwsxt\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429352 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429140 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-podinfo\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429352 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429240 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-token\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429352 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429295 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-certs\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429352 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429330 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-data\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429611 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429364 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-credential-socket\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429611 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429399 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-socket\") pod \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\" (UID: \"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482\") " Jun 10 11:55:35.429611 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429434 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:55:35.429777 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429683 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:35.429777 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429741 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istiod-ca-cert\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.429935 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429875 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:35.430085 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.429940 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:35.430161 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.430138 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:35.431948 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.431915 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 11:55:35.432040 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.431963 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:35.432040 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.431972 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-kube-api-access-rwsxt" (OuterVolumeSpecName: "kube-api-access-rwsxt") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "kube-api-access-rwsxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:55:35.432242 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.432220 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" (UID: "0a7eb4e0-83a4-46ac-9d13-a6e2200f5482"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:55:35.531251 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531222 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-token\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531251 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531247 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-certs\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531251 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531256 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-data\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531493 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531265 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-credential-socket\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531493 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531275 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-workload-socket\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531493 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531283 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-envoy\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531493 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531292 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwsxt\" (UniqueName: \"kubernetes.io/projected/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-kube-api-access-rwsxt\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.531493 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.531322 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482-istio-podinfo\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:35.883001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.882970 2563 generic.go:356] "Generic (PLEG): container finished" podID="0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" containerID="f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834" exitCode=0 Jun 10 11:55:35.883279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.883042 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" Jun 10 11:55:35.883279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.883062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" event={"ID":"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482","Type":"ContainerDied","Data":"f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834"} Jun 10 11:55:35.883279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.883133 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj" event={"ID":"0a7eb4e0-83a4-46ac-9d13-a6e2200f5482","Type":"ContainerDied","Data":"fe1280c1e3654c02aadb1bc6fcc5050b33db62195b95d19a9b1d890d58dfe827"} Jun 10 11:55:35.883279 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.883158 2563 scope.go:117] "RemoveContainer" containerID="f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834" Jun 10 11:55:35.893046 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.893028 2563 scope.go:117] "RemoveContainer" containerID="f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834" Jun 10 11:55:35.893313 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:55:35.893297 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834\": container with ID starting with f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834 not found: ID does not exist" containerID="f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834" Jun 10 11:55:35.893378 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.893319 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834"} err="failed to get container status \"f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834\": rpc error: code = NotFound desc = could not find container \"f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834\": container with ID starting with f04646e6f1a0d99a41b735854a0f7c803ca5599dc4a4039acfcc72f3a70dc834 not found: ID does not exist" Jun 10 11:55:35.913277 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.913250 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj"] Jun 10 11:55:35.918918 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:35.918895 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1c7082b3-openshift-default-97656c658-dhfmj"] Jun 10 11:55:36.600387 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:36.600352 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" path="/var/lib/kubelet/pods/0a7eb4e0-83a4-46ac-9d13-a6e2200f5482/volumes" Jun 10 11:55:37.749747 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.749712 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb"] Jun 10 11:55:37.750227 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.750150 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" containerName="istio-proxy" Jun 10 11:55:37.750227 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.750162 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" containerName="istio-proxy" Jun 10 11:55:37.750359 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.750254 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7eb4e0-83a4-46ac-9d13-a6e2200f5482" containerName="istio-proxy" Jun 10 11:55:37.753391 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.753368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.758700 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.758678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-677a7597-openshift-default-dockercfg-qlqph\"" Jun 10 11:55:37.774089 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.774055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb"] Jun 10 11:55:37.855002 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.854961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-token\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a454ccc1-c68d-49fc-8be8-b663fdf24182-istiod-ca-cert\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-data\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-envoy\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnbjx\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-kube-api-access-gnbjx\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-socket\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-certs\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855208 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-podinfo\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.855474 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.855292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-credential-socket\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956039 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-credential-socket\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956261 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-token\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956261 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a454ccc1-c68d-49fc-8be8-b663fdf24182-istiod-ca-cert\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956261 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-data\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956261 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-envoy\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956502 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnbjx\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-kube-api-access-gnbjx\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956502 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-socket\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956502 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-certs\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956502 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-podinfo\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956705 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-credential-socket\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956705 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-data\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956823 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-certs\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956823 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956754 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-socket\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.956956 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.956937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a454ccc1-c68d-49fc-8be8-b663fdf24182-istiod-ca-cert\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.958514 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.958491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-envoy\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.958730 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.958710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-podinfo\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:37.987269 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:37.987235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-token\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:38.009693 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.009616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnbjx\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-kube-api-access-gnbjx\") pod \"e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:38.064382 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.064343 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:38.236474 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.236440 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb"] Jun 10 11:55:38.239295 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:55:38.239267 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda454ccc1_c68d_49fc_8be8_b663fdf24182.slice/crio-a06c3da423c0cdd8a29dcffa47456aacb4fae5a723413357e42430de3b9f34fb WatchSource:0}: Error finding container a06c3da423c0cdd8a29dcffa47456aacb4fae5a723413357e42430de3b9f34fb: Status 404 returned error can't find the container with id a06c3da423c0cdd8a29dcffa47456aacb4fae5a723413357e42430de3b9f34fb Jun 10 11:55:38.241497 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.241464 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:55:38.241588 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.241543 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:55:38.241656 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.241587 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 11:55:38.902988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.902939 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" event={"ID":"a454ccc1-c68d-49fc-8be8-b663fdf24182","Type":"ContainerStarted","Data":"8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16"} Jun 10 11:55:38.903454 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:38.903052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" event={"ID":"a454ccc1-c68d-49fc-8be8-b663fdf24182","Type":"ContainerStarted","Data":"a06c3da423c0cdd8a29dcffa47456aacb4fae5a723413357e42430de3b9f34fb"} Jun 10 11:55:39.065453 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:39.065414 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:39.075483 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:39.075453 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:39.212648 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:39.212540 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" podStartSLOduration=2.21252436 podStartE2EDuration="2.21252436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:55:38.953037777 +0000 UTC m=+2184.796114702" watchObservedRunningTime="2026-06-10 11:55:39.21252436 +0000 UTC m=+2185.055601254" Jun 10 11:55:39.908355 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:39.908317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:39.909474 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:39.909449 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:45.375925 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:45.375888 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb"] Jun 10 11:55:45.376597 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:45.376194 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" podUID="a454ccc1-c68d-49fc-8be8-b663fdf24182" containerName="istio-proxy" containerID="cri-o://8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16" gracePeriod=30 Jun 10 11:55:50.632594 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.632568 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:50.789969 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.789929 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-token\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790210 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.789981 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-credential-socket\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790210 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790017 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-envoy\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790210 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790063 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-podinfo\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790210 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790086 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-socket\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790210 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790140 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-data\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790492 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790231 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a454ccc1-c68d-49fc-8be8-b663fdf24182-istiod-ca-cert\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790492 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790256 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnbjx\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-kube-api-access-gnbjx\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790492 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790314 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-certs\") pod \"a454ccc1-c68d-49fc-8be8-b663fdf24182\" (UID: \"a454ccc1-c68d-49fc-8be8-b663fdf24182\") " Jun 10 11:55:50.790492 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790364 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:50.790704 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790566 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-data" (OuterVolumeSpecName: "istio-data") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:50.790704 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790692 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-credential-socket\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.790813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790698 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a454ccc1-c68d-49fc-8be8-b663fdf24182-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:55:50.790813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790710 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-data\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.790813 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790771 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:50.790972 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.790908 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:50.792563 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.792536 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:55:50.792791 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.792766 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-token" (OuterVolumeSpecName: "istio-token") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:55:50.792878 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.792810 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-kube-api-access-gnbjx" (OuterVolumeSpecName: "kube-api-access-gnbjx") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "kube-api-access-gnbjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:55:50.792878 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.792840 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a454ccc1-c68d-49fc-8be8-b663fdf24182" (UID: "a454ccc1-c68d-49fc-8be8-b663fdf24182"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 11:55:50.892037 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.891997 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a454ccc1-c68d-49fc-8be8-b663fdf24182-istiod-ca-cert\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.892037 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.892030 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnbjx\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-kube-api-access-gnbjx\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.892037 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.892043 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-certs\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.892308 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.892056 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-token\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.892308 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.892067 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-envoy\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.892308 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.892077 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a454ccc1-c68d-49fc-8be8-b663fdf24182-istio-podinfo\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.892308 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.892087 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a454ccc1-c68d-49fc-8be8-b663fdf24182-workload-socket\") on node \"ip-10-0-138-53.ec2.internal\" DevicePath \"\"" Jun 10 11:55:50.967600 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.967564 2563 generic.go:356] "Generic (PLEG): container finished" podID="a454ccc1-c68d-49fc-8be8-b663fdf24182" containerID="8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16" exitCode=0 Jun 10 11:55:50.967802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.967610 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" Jun 10 11:55:50.967802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.967644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" event={"ID":"a454ccc1-c68d-49fc-8be8-b663fdf24182","Type":"ContainerDied","Data":"8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16"} Jun 10 11:55:50.967802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.967696 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb" event={"ID":"a454ccc1-c68d-49fc-8be8-b663fdf24182","Type":"ContainerDied","Data":"a06c3da423c0cdd8a29dcffa47456aacb4fae5a723413357e42430de3b9f34fb"} Jun 10 11:55:50.967802 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.967724 2563 scope.go:117] "RemoveContainer" containerID="8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16" Jun 10 11:55:50.977680 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.977662 2563 scope.go:117] "RemoveContainer" containerID="8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16" Jun 10 11:55:50.977934 ip-10-0-138-53 kubenswrapper[2563]: E0610 11:55:50.977919 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16\": container with ID starting with 8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16 not found: ID does not exist" containerID="8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16" Jun 10 11:55:50.977984 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.977940 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16"} err="failed to get container status \"8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16\": rpc error: code = NotFound desc = could not find container \"8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16\": container with ID starting with 8f515f2fe85296d674004839b20e1d9cc1f6b75edb4258a84416eee8fba88e16 not found: ID does not exist" Jun 10 11:55:50.996985 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:50.996953 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb"] Jun 10 11:55:51.002268 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:51.002243 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-677a7597-openshift-default-685d8d9fb4-zg2vb"] Jun 10 11:55:52.599422 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:55:52.599385 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a454ccc1-c68d-49fc-8be8-b663fdf24182" path="/var/lib/kubelet/pods/a454ccc1-c68d-49fc-8be8-b663fdf24182/volumes" Jun 10 11:56:04.034083 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:04.028379 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6dbdd44544-4n5d2_78289df2-c7df-4580-be55-032222ff7af2/nginx/0.log" Jun 10 11:56:05.356326 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:05.356294 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-g6cdn_2f9d6202-421e-4133-8d83-c7b7432cc86a/copy-manifests/0.log" Jun 10 11:56:05.366838 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:05.366809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-g6cdn_2f9d6202-421e-4133-8d83-c7b7432cc86a/manager/0.log" Jun 10 11:56:07.103987 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:07.103956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kv4gc_4696f484-2993-4fcc-891c-89e56ebfd9e6/manager/0.log" Jun 10 11:56:07.217768 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:07.217737 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vmxmx_6236c2fa-44a1-4e3f-8f23-bbf981116464/manager/0.log" Jun 10 11:56:07.448833 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:07.448754 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t6hfm_ae40a27f-40f1-43e9-bf94-87d4bc122c6d/registry-server/0.log" Jun 10 11:56:07.708529 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:07.708445 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zzw7d_de9c9ec5-5628-4d73-8783-f947b8748437/limitador/0.log" Jun 10 11:56:07.845535 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:07.845508 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k8fr7_e90321b0-3776-4576-a7c2-832fd9521f2c/manager/0.log" Jun 10 11:56:08.203495 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:08.203461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795829zn_19fbf978-eb70-4730-aff5-f496addbb6cc/istio-proxy/0.log" Jun 10 11:56:08.702372 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:08.702331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/1.log" Jun 10 11:56:08.973768 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:08.973694 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rk2f2_06ee845e-99cb-4143-9c19-d4344f12812b/payload-processing/0.log" Jun 10 11:56:09.845080 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:09.845050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn_20856093-d059-4274-8dee-a17e8f969c0c/storage-initializer/0.log" Jun 10 11:56:09.852545 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:09.852514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnpqkn_20856093-d059-4274-8dee-a17e8f969c0c/main/0.log" Jun 10 11:56:09.966973 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:09.966943 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5_8dc76694-08a3-48e2-a4ec-2740c9de798a/storage-initializer/0.log" Jun 10 11:56:09.977045 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:09.977020 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4hqp5_8dc76694-08a3-48e2-a4ec-2740c9de798a/main/0.log" Jun 10 11:56:10.091418 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:10.091380 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-nwldm_359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1/storage-initializer/0.log" Jun 10 11:56:10.098294 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:10.098235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-nwldm_359f1bd6-01dd-4d24-9ba6-18ea4f1f78a1/main/0.log" Jun 10 11:56:17.498880 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:17.498822 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hf5df_803f43d5-0da4-4c72-b16f-e1f93933e1dc/global-pull-secret-syncer/0.log" Jun 10 11:56:17.704109 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:17.704078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vpd7p_bc769c60-6659-4c4d-b028-df71e55ca00d/konnectivity-agent/0.log" Jun 10 11:56:17.775528 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:17.775441 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-53.ec2.internal_6611c8dde505a3fb53f8c589ba6ee1b9/haproxy/0.log" Jun 10 11:56:21.956124 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:21.956038 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kv4gc_4696f484-2993-4fcc-891c-89e56ebfd9e6/manager/0.log" Jun 10 11:56:21.998713 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:21.998686 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vmxmx_6236c2fa-44a1-4e3f-8f23-bbf981116464/manager/0.log" Jun 10 11:56:22.087374 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:22.087335 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t6hfm_ae40a27f-40f1-43e9-bf94-87d4bc122c6d/registry-server/0.log" Jun 10 11:56:22.215658 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:22.215585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zzw7d_de9c9ec5-5628-4d73-8783-f947b8748437/limitador/0.log" Jun 10 11:56:22.285170 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:22.285136 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k8fr7_e90321b0-3776-4576-a7c2-832fd9521f2c/manager/0.log" Jun 10 11:56:23.993488 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:23.993457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/alertmanager/0.log" Jun 10 11:56:24.025764 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.025739 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/config-reloader/0.log" Jun 10 11:56:24.069366 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.069342 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/kube-rbac-proxy-web/0.log" Jun 10 11:56:24.104048 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.104023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/kube-rbac-proxy/0.log" Jun 10 11:56:24.130675 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.130650 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/kube-rbac-proxy-metric/0.log" Jun 10 11:56:24.175137 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.175107 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/prom-label-proxy/0.log" Jun 10 11:56:24.210939 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.210907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa29eb02-218d-4f7c-82e4-24fa9212dddf/init-config-reloader/0.log" Jun 10 11:56:24.289561 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.289473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-h9dsx_de501e9c-f4b9-47e4-b7d4-2aa4f999437e/kube-state-metrics/0.log" Jun 10 11:56:24.328902 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.328876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-h9dsx_de501e9c-f4b9-47e4-b7d4-2aa4f999437e/kube-rbac-proxy-main/0.log" Jun 10 11:56:24.361585 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.361558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-h9dsx_de501e9c-f4b9-47e4-b7d4-2aa4f999437e/kube-rbac-proxy-self/0.log" Jun 10 11:56:24.394104 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.394070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9c66db8b9-5kd28_b955f1f7-500a-4c3b-a532-e951356544d9/metrics-server/0.log" Jun 10 11:56:24.426103 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.426075 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kdzbh_902446ec-6df9-421b-a1b3-6a221c9d0f9e/monitoring-plugin/0.log" Jun 10 11:56:24.669803 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.669780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qr7js_48eefd03-4e72-4042-b9ee-902ad373fa1b/node-exporter/0.log" Jun 10 11:56:24.696024 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.695991 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qr7js_48eefd03-4e72-4042-b9ee-902ad373fa1b/kube-rbac-proxy/0.log" Jun 10 11:56:24.725673 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.725645 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qr7js_48eefd03-4e72-4042-b9ee-902ad373fa1b/init-textfile/0.log" Jun 10 11:56:24.760035 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.760006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-c7m56_605e6c89-0289-4563-aaf7-2e0c48c52e0e/kube-rbac-proxy-main/0.log" Jun 10 11:56:24.812338 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.812305 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-c7m56_605e6c89-0289-4563-aaf7-2e0c48c52e0e/kube-rbac-proxy-self/0.log" Jun 10 11:56:24.870960 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.870931 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-c7m56_605e6c89-0289-4563-aaf7-2e0c48c52e0e/openshift-state-metrics/0.log" Jun 10 11:56:24.967019 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:24.966931 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/prometheus/0.log" Jun 10 11:56:25.039961 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.039939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/config-reloader/0.log" Jun 10 11:56:25.095043 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.095021 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/thanos-sidecar/0.log" Jun 10 11:56:25.148457 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.148429 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/kube-rbac-proxy-web/0.log" Jun 10 11:56:25.195606 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.195578 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/kube-rbac-proxy/0.log" Jun 10 11:56:25.225668 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.225597 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/kube-rbac-proxy-thanos/0.log" Jun 10 11:56:25.253840 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.253804 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bb4611d-1e38-4b71-946b-be86d5846e42/init-config-reloader/0.log" Jun 10 11:56:25.291759 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.291732 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-l7gcl_e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca/prometheus-operator/0.log" Jun 10 11:56:25.313980 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.313929 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-l7gcl_e1c5a778-8ed5-404b-a49d-0ffc7c5c02ca/kube-rbac-proxy/0.log" Jun 10 11:56:25.375011 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.374981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb7f67b6c-zhcjm_0222bd2b-e97a-47af-8898-7b8122cff36c/telemeter-client/0.log" Jun 10 11:56:25.409328 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.409303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb7f67b6c-zhcjm_0222bd2b-e97a-47af-8898-7b8122cff36c/reload/0.log" Jun 10 11:56:25.446021 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.445998 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb7f67b6c-zhcjm_0222bd2b-e97a-47af-8898-7b8122cff36c/kube-rbac-proxy/0.log" Jun 10 11:56:25.495360 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.495330 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb898f46-g2zs5_1bb2643a-bbd6-4191-a688-25c7e161ac3e/thanos-query/0.log" Jun 10 11:56:25.518283 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.518249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb898f46-g2zs5_1bb2643a-bbd6-4191-a688-25c7e161ac3e/kube-rbac-proxy-web/0.log" Jun 10 11:56:25.548723 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.548681 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb898f46-g2zs5_1bb2643a-bbd6-4191-a688-25c7e161ac3e/kube-rbac-proxy/0.log" Jun 10 11:56:25.588497 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.588471 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb898f46-g2zs5_1bb2643a-bbd6-4191-a688-25c7e161ac3e/prom-label-proxy/0.log" Jun 10 11:56:25.616893 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.616846 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb898f46-g2zs5_1bb2643a-bbd6-4191-a688-25c7e161ac3e/kube-rbac-proxy-rules/0.log" Jun 10 11:56:25.647282 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:25.647260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb898f46-g2zs5_1bb2643a-bbd6-4191-a688-25c7e161ac3e/kube-rbac-proxy-metrics/0.log" Jun 10 11:56:28.591536 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:28.591503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b58b57ff8-fg5r6_ae8e5167-4e0d-4982-8b70-85250e8beac6/console/0.log" Jun 10 11:56:29.635978 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.635940 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2"] Jun 10 11:56:29.636440 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.636429 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a454ccc1-c68d-49fc-8be8-b663fdf24182" containerName="istio-proxy" Jun 10 11:56:29.636491 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.636443 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a454ccc1-c68d-49fc-8be8-b663fdf24182" containerName="istio-proxy" Jun 10 11:56:29.636546 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.636535 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a454ccc1-c68d-49fc-8be8-b663fdf24182" containerName="istio-proxy" Jun 10 11:56:29.640944 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.640923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.644659 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.644627 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dspfd\"/\"openshift-service-ca.crt\"" Jun 10 11:56:29.644796 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.644731 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dspfd\"/\"kube-root-ca.crt\"" Jun 10 11:56:29.646017 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.645998 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dspfd\"/\"default-dockercfg-4lqkz\"" Jun 10 11:56:29.657848 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.657824 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2"] Jun 10 11:56:29.759437 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.759402 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-sys\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.759621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.759468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-podres\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.759621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.759507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-lib-modules\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.759621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.759540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-proc\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.759621 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.759561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9fj6\" (UniqueName: \"kubernetes.io/projected/1fa6828a-ab57-403d-a6e2-f09ced2701e5-kube-api-access-m9fj6\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860384 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-sys\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-podres\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-lib-modules\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-proc\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9fj6\" (UniqueName: \"kubernetes.io/projected/1fa6828a-ab57-403d-a6e2-f09ced2701e5-kube-api-access-m9fj6\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-sys\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860560 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860555 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-podres\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860771 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-proc\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.860771 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.860601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fa6828a-ab57-403d-a6e2-f09ced2701e5-lib-modules\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.871801 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.871775 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9fj6\" (UniqueName: \"kubernetes.io/projected/1fa6828a-ab57-403d-a6e2-f09ced2701e5-kube-api-access-m9fj6\") pod \"perf-node-gather-daemonset-74xm2\" (UID: \"1fa6828a-ab57-403d-a6e2-f09ced2701e5\") " pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:29.951990 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:29.951842 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:30.095776 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:30.095710 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2"] Jun 10 11:56:30.098250 ip-10-0-138-53 kubenswrapper[2563]: W0610 11:56:30.098221 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1fa6828a_ab57_403d_a6e2_f09ced2701e5.slice/crio-0ca8013db52b79221156ba1331a9e2ecd952c6d0f59dee7e709225b8498d6528 WatchSource:0}: Error finding container 0ca8013db52b79221156ba1331a9e2ecd952c6d0f59dee7e709225b8498d6528: Status 404 returned error can't find the container with id 0ca8013db52b79221156ba1331a9e2ecd952c6d0f59dee7e709225b8498d6528 Jun 10 11:56:30.174602 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:30.174572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" event={"ID":"1fa6828a-ab57-403d-a6e2-f09ced2701e5","Type":"ContainerStarted","Data":"0ca8013db52b79221156ba1331a9e2ecd952c6d0f59dee7e709225b8498d6528"} Jun 10 11:56:30.893285 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:30.893251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ljsmw_5cdbb787-fa8e-47fd-919f-21486c4cf74a/dns/0.log" Jun 10 11:56:30.942675 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:30.942646 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ljsmw_5cdbb787-fa8e-47fd-919f-21486c4cf74a/kube-rbac-proxy/0.log" Jun 10 11:56:31.181200 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:31.181067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" event={"ID":"1fa6828a-ab57-403d-a6e2-f09ced2701e5","Type":"ContainerStarted","Data":"d24d1745c28ae4f571ab2c01eb8af3152eacd98ead8b770f983a8e16090ad8b6"} Jun 10 11:56:31.181200 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:31.181155 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:31.181833 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:31.181807 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n7bh5_4a436461-c5b2-427f-94bc-f8b9852fd0e9/dns-node-resolver/0.log" Jun 10 11:56:31.207251 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:31.207206 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" podStartSLOduration=2.207189679 podStartE2EDuration="2.207189679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:56:31.205892533 +0000 UTC m=+2237.048969463" watchObservedRunningTime="2026-06-10 11:56:31.207189679 +0000 UTC m=+2237.050266586" Jun 10 11:56:31.979988 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:31.979956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cgfzx_2450c6e8-d08e-4be1-abd8-5b04aa85f34f/node-ca/0.log" Jun 10 11:56:33.364202 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:33.364163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795829zn_19fbf978-eb70-4730-aff5-f496addbb6cc/istio-proxy/0.log" Jun 10 11:56:33.714648 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:33.714551 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/0.log" Jun 10 11:56:33.742727 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:33.742694 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/1.log" Jun 10 11:56:33.955848 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:33.955814 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rk2f2_06ee845e-99cb-4143-9c19-d4344f12812b/payload-processing/0.log" Jun 10 11:56:34.878426 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:34.878396 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k55sv_75b1492c-2fd8-466f-a8c1-9042721e0113/serve-healthcheck-canary/0.log" Jun 10 11:56:35.883539 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:35.883504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sk5hx_120824b8-5c35-4031-994e-11128194c101/kube-rbac-proxy/0.log" Jun 10 11:56:35.926440 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:35.926415 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sk5hx_120824b8-5c35-4031-994e-11128194c101/exporter/0.log" Jun 10 11:56:35.968620 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:35.968594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sk5hx_120824b8-5c35-4031-994e-11128194c101/extractor/0.log" Jun 10 11:56:37.196798 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:37.196770 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dspfd/perf-node-gather-daemonset-74xm2" Jun 10 11:56:38.938042 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:38.938003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6dbdd44544-4n5d2_78289df2-c7df-4580-be55-032222ff7af2/nginx/0.log" Jun 10 11:56:39.662156 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:39.662103 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-g6cdn_2f9d6202-421e-4133-8d83-c7b7432cc86a/manager/0.log" Jun 10 11:56:39.689870 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:39.689843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf8c6bd97-g6cdn_2f9d6202-421e-4133-8d83-c7b7432cc86a/copy-manifests/0.log" Jun 10 11:56:41.429437 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:41.429339 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7665f65bcf-6h2f5_951ce83f-d057-4907-b36b-377c08a99d65/manager/0.log" Jun 10 11:56:41.514627 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:41.514598 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rwbd4_cec4b351-b4f8-40f7-919c-58798ffc27a2/openshift-lws-operator/0.log" Jun 10 11:56:42.257001 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:42.256973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795829zn_19fbf978-eb70-4730-aff5-f496addbb6cc/istio-proxy/0.log" Jun 10 11:56:42.412159 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:42.412122 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/0.log" Jun 10 11:56:42.449240 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:42.449210 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/1.log" Jun 10 11:56:42.525704 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:42.525624 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rk2f2_06ee845e-99cb-4143-9c19-d4344f12812b/payload-processing/0.log" Jun 10 11:56:43.639522 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:43.639493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795829zn_19fbf978-eb70-4730-aff5-f496addbb6cc/istio-proxy/0.log" Jun 10 11:56:43.801089 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:43.801056 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/0.log" Jun 10 11:56:43.835969 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:43.835930 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/1.log" Jun 10 11:56:43.914019 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:43.913917 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rk2f2_06ee845e-99cb-4143-9c19-d4344f12812b/payload-processing/0.log" Jun 10 11:56:45.753103 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:45.753076 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795829zn_19fbf978-eb70-4730-aff5-f496addbb6cc/istio-proxy/0.log" Jun 10 11:56:45.908703 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:45.908670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/0.log" Jun 10 11:56:45.939691 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:45.939655 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtn89_2e635ea1-6db1-474f-afab-201c01383754/istio-proxy/1.log" Jun 10 11:56:46.007960 ip-10-0-138-53 kubenswrapper[2563]: I0610 11:56:46.007867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rk2f2_06ee845e-99cb-4143-9c19-d4344f12812b/payload-processing/0.log"