May 27 21:06:15.039205 ip-10-0-136-186 systemd[1]: Starting Kubernetes Kubelet... May 27 21:06:15.450720 ip-10-0-136-186 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:06:15.450720 ip-10-0-136-186 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 21:06:15.450720 ip-10-0-136-186 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:06:15.450720 ip-10-0-136-186 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 21:06:15.450720 ip-10-0-136-186 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:06:15.453116 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.452995 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 21:06:15.455724 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455710 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.455724 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455724 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455728 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455733 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455736 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455739 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455742 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455745 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455749 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455752 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455754 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455757 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455759 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455762 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455765 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455768 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455771 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455775 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455779 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455782 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.455792 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455784 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455787 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455790 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455793 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455796 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455799 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455802 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455804 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455807 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455810 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455813 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455815 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455818 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455820 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455822 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455825 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455827 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455830 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455832 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455834 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.456255 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455837 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455840 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455842 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455845 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455848 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455850 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455852 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455855 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455857 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455860 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455862 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455865 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455867 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455870 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455873 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455876 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455879 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455881 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455884 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455886 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.456742 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455889 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455894 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455897 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455900 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455903 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455906 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455909 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455912 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455915 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455930 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455933 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455936 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455938 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455941 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455944 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455947 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455949 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455952 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455954 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.457257 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455957 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455959 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455962 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455965 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455967 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455970 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.455972 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456333 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456338 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456340 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456343 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456346 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456348 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456351 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456354 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456356 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456359 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456361 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456364 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456367 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.457727 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456369 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456372 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456374 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456377 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456380 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456382 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456385 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456388 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456391 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456393 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456397 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456401 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456404 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456406 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456409 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456411 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456414 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456417 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456419 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.458230 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456422 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456425 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456428 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456431 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456433 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456436 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456438 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456441 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456443 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456446 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456449 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456451 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456454 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456457 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456459 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456462 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456464 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456467 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456469 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.458698 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456472 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456475 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456477 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456480 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456482 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456485 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456487 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456490 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456492 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456494 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456497 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456500 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456502 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456505 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456508 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456511 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456514 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456518 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456522 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456525 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.459187 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456528 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456530 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456533 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456535 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456538 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456541 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456543 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456546 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456548 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456550 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456553 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456556 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456558 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456561 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.456563 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457733 2566 flags.go:64] FLAG: --address="0.0.0.0" May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457742 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457748 2566 flags.go:64] FLAG: --anonymous-auth="true" May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457753 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457757 2566 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457760 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 21:06:15.459681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457764 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457768 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457771 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457774 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457778 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457782 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457785 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457788 2566 flags.go:64] FLAG: --cgroup-root="" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457791 2566 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457794 2566 flags.go:64] FLAG: --client-ca-file="" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457797 2566 flags.go:64] FLAG: --cloud-config="" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457800 2566 flags.go:64] FLAG: --cloud-provider="external" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457802 2566 flags.go:64] FLAG: --cluster-dns="[]" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457807 2566 flags.go:64] FLAG: --cluster-domain="" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457810 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457813 2566 flags.go:64] FLAG: --config-dir="" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457816 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457819 2566 flags.go:64] FLAG: --container-log-max-files="5" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457823 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457826 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457829 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457832 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457835 2566 flags.go:64] FLAG: --contention-profiling="false" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457839 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 21:06:15.460214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457842 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457845 2566 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457848 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457852 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457855 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457858 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457860 2566 flags.go:64] FLAG: --enable-load-reader="false" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457863 2566 flags.go:64] FLAG: --enable-server="true" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457866 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457870 2566 flags.go:64] FLAG: --event-burst="100" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457873 2566 flags.go:64] FLAG: --event-qps="50" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457876 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457880 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457883 2566 flags.go:64] FLAG: --eviction-hard="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457886 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457889 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457893 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457896 2566 flags.go:64] FLAG: --eviction-soft="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457899 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457902 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457905 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457907 2566 flags.go:64] FLAG: --experimental-mounter-path="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457910 2566 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457913 2566 flags.go:64] FLAG: --fail-swap-on="true" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457916 2566 flags.go:64] FLAG: --feature-gates="" May 27 21:06:15.460806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457931 2566 flags.go:64] FLAG: --file-check-frequency="20s" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457934 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457937 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457940 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457944 2566 flags.go:64] FLAG: --healthz-port="10248" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457947 2566 flags.go:64] FLAG: --help="false" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457950 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-136-186.ec2.internal" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457956 2566 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457959 2566 flags.go:64] FLAG: --http-check-frequency="20s" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457962 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457966 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457969 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457972 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457975 2566 flags.go:64] FLAG: --image-service-endpoint="" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457978 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457981 2566 flags.go:64] FLAG: --kube-api-burst="100" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457984 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457987 2566 flags.go:64] FLAG: --kube-api-qps="50" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457989 2566 flags.go:64] FLAG: --kube-reserved="" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457993 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457996 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.457999 2566 flags.go:64] FLAG: --kubelet-cgroups="" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458002 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458004 2566 flags.go:64] FLAG: --lock-file="" May 27 21:06:15.461422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458008 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458011 2566 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458014 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458019 2566 flags.go:64] FLAG: --log-json-split-stream="false" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458022 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458024 2566 flags.go:64] FLAG: --log-text-split-stream="false" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458027 2566 flags.go:64] FLAG: --logging-format="text" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458030 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458033 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458036 2566 flags.go:64] FLAG: --manifest-url="" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458039 2566 flags.go:64] FLAG: --manifest-url-header="" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458043 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458046 2566 flags.go:64] FLAG: --max-open-files="1000000" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458050 2566 flags.go:64] FLAG: --max-pods="110" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458053 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458056 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458059 2566 flags.go:64] FLAG: --memory-manager-policy="None" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458062 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458065 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458068 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458070 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458077 2566 flags.go:64] FLAG: --node-status-max-images="50" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458080 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458083 2566 flags.go:64] FLAG: --oom-score-adj="-999" May 27 21:06:15.462073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458087 2566 flags.go:64] FLAG: --pod-cidr="" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458089 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458095 2566 flags.go:64] FLAG: --pod-manifest-path="" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458098 2566 flags.go:64] FLAG: --pod-max-pids="-1" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458101 2566 flags.go:64] FLAG: --pods-per-core="0" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458104 2566 flags.go:64] FLAG: --port="10250" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458107 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458111 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c84b8b58150714b9" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458114 2566 flags.go:64] FLAG: --qos-reserved="" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458117 2566 flags.go:64] FLAG: --read-only-port="10255" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458120 2566 flags.go:64] FLAG: --register-node="true" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458123 2566 flags.go:64] FLAG: --register-schedulable="true" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458126 2566 flags.go:64] FLAG: --register-with-taints="" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458129 2566 flags.go:64] FLAG: --registry-burst="10" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458132 2566 flags.go:64] FLAG: --registry-qps="5" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458135 2566 flags.go:64] FLAG: --reserved-cpus="" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458138 2566 flags.go:64] FLAG: --reserved-memory="" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458141 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458144 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458147 2566 flags.go:64] FLAG: --rotate-certificates="false" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458150 2566 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458153 2566 flags.go:64] FLAG: --runonce="false" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458156 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458159 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458161 2566 flags.go:64] FLAG: --seccomp-default="false" May 27 21:06:15.462679 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458165 2566 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458168 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458170 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458173 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458177 2566 flags.go:64] FLAG: --storage-driver-password="root" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458179 2566 flags.go:64] FLAG: --storage-driver-secure="false" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458182 2566 flags.go:64] FLAG: --storage-driver-table="stats" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458185 2566 flags.go:64] FLAG: --storage-driver-user="root" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458188 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458190 2566 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458193 2566 flags.go:64] FLAG: --system-cgroups="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458196 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458201 2566 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458204 2566 flags.go:64] FLAG: --tls-cert-file="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458223 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458228 2566 flags.go:64] FLAG: --tls-min-version="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458231 2566 flags.go:64] FLAG: --tls-private-key-file="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458234 2566 flags.go:64] FLAG: --topology-manager-policy="none" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458238 2566 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458241 2566 flags.go:64] FLAG: --topology-manager-scope="container" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458244 2566 flags.go:64] FLAG: --v="2" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458248 2566 flags.go:64] FLAG: --version="false" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458252 2566 flags.go:64] FLAG: --vmodule="" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458256 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.458259 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 21:06:15.463301 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458346 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458349 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458352 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458355 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458358 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458361 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458363 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458366 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458369 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458372 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458374 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458377 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458379 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458382 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458384 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458387 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458389 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458392 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458398 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458400 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.464017 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458403 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458406 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458408 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458411 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458414 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458417 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458420 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458423 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458425 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458428 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458431 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458433 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458436 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458438 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458441 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458444 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458446 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458449 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458453 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458456 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.464862 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458458 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458461 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458464 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458466 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458469 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458471 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458474 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458476 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458479 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458481 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458486 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458489 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458491 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458495 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458497 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458501 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458505 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458508 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458512 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.465750 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458514 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458517 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458520 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458522 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458525 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458527 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458530 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458532 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458535 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458537 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458540 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458542 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458545 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458547 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458550 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458553 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458556 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458560 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458563 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.466329 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458565 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458568 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458570 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458573 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458577 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458579 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458582 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.458586 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.459187 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.466498 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.466519 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466593 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466602 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466608 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466614 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.467074 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466619 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466624 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466628 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466633 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466637 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466641 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466645 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466649 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466653 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466658 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466662 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466666 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466671 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466675 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466679 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466692 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466697 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466701 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466706 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466710 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.467725 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466715 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466719 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466723 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466727 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466731 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466735 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466740 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466746 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466751 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466755 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466762 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466770 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466775 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466780 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466784 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466788 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466792 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466796 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466800 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466804 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.468261 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466809 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466813 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466817 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466821 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466825 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466832 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466838 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466842 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466846 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466851 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466855 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466860 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466864 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466868 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466872 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466876 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466881 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466885 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466889 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.468878 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466893 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466898 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466903 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466907 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466912 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466931 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466936 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466940 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466945 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466949 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466953 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466957 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466961 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466965 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466969 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466973 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466977 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466982 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466986 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466990 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.469569 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466994 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.466998 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467002 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.467010 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467190 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467201 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467206 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467210 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467214 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467218 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467223 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467228 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467233 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467237 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467243 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.470549 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467248 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467252 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467256 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467260 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467264 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467268 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467272 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467277 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467281 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467285 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467290 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467294 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467298 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467302 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467306 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467310 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467315 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467319 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467325 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.471026 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467331 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467336 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467340 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467344 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467348 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467352 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467356 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467360 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467365 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467369 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467373 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467377 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467381 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467386 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467391 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467395 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467399 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467403 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467407 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467412 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.471631 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467416 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467421 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467425 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467429 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467434 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467438 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467442 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467446 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467451 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467458 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467463 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467468 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467473 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467477 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467482 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467486 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467490 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467494 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467498 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.472147 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467502 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467506 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467510 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467515 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467519 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467523 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467527 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467532 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467537 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467541 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467545 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467549 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467554 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467557 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467561 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467565 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.472669 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:15.467570 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.473104 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.467577 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:06:15.473104 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.468547 2566 server.go:962] "Client rotation is on, will bootstrap in background" May 27 21:06:15.473104 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.471348 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 21:06:15.473104 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.472398 2566 server.go:1019] "Starting client certificate rotation" May 27 21:06:15.473104 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.472506 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:06:15.473305 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.473289 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:06:15.496038 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.496015 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:06:15.501495 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.501460 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:06:15.518141 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.518125 2566 log.go:25] "Validated CRI v1 runtime API" May 27 21:06:15.523163 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.523148 2566 log.go:25] "Validated CRI v1 image API" May 27 21:06:15.524257 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.524239 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 21:06:15.524402 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.524385 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:06:15.528991 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.528970 2566 fs.go:135] Filesystem UUIDs: map[41caab6a-ae0a-4aa9-a20b-429f3d48c498:/dev/nvme0n1p4 754a7893-1d51-4daa-9bd4-94633935d418:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 27 21:06:15.529047 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.528991 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 21:06:15.533571 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.533469 2566 manager.go:217] Machine: {Timestamp:2026-05-27 21:06:15.533001034 +0000 UTC m=+0.383450082 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103252 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2db6ef2ff0fb400b5cae526afc2601 SystemUUID:ec2db6ef-2ff0-fb40-0b5c-ae526afc2601 BootID:3191f0e8-7bf3-42ed-b5f8-ae94936e8721 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:7c:b7:f9:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:7c:b7:f9:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:7a:88:4b:2b:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 21:06:15.534191 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.534181 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 21:06:15.534275 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.534263 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 21:06:15.536221 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.536201 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 21:06:15.536347 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.536224 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 21:06:15.536401 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.536357 2566 topology_manager.go:138] "Creating topology manager with none policy" May 27 21:06:15.536401 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.536366 2566 container_manager_linux.go:306] "Creating device plugin manager" May 27 21:06:15.536401 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.536373 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:06:15.537860 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.537850 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:06:15.539898 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.539889 2566 state_mem.go:36] "Initialized new in-memory state store" May 27 21:06:15.540020 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.540011 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 21:06:15.542506 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.542497 2566 kubelet.go:491] "Attempting to sync node with API server" May 27 21:06:15.542545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.542510 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 21:06:15.542545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.542521 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 21:06:15.542545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.542531 2566 kubelet.go:397] "Adding apiserver pod source" May 27 21:06:15.542545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.542539 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 21:06:15.543587 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.543574 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:06:15.543649 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.543595 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:06:15.543698 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.543677 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4kx7" May 27 21:06:15.546566 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.546552 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 21:06:15.548422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.548409 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 21:06:15.550855 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550837 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550860 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550867 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550879 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550890 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550899 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550911 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550934 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 21:06:15.550947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550946 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 21:06:15.551181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550955 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 21:06:15.551181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550968 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 21:06:15.551181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.550979 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 21:06:15.551821 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.551804 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 21:06:15.551897 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.551827 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 21:06:15.552992 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.552974 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4kx7" May 27 21:06:15.554743 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.554725 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 21:06:15.554821 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.554786 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 21:06:15.554936 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.554905 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 21:06:15.555261 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.555248 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 21:06:15.555301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.555291 2566 server.go:1295] "Started kubelet" May 27 21:06:15.555417 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.555359 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 21:06:15.555453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.555434 2566 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 21:06:15.555495 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.555467 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 21:06:15.555987 ip-10-0-136-186 systemd[1]: Started Kubernetes Kubelet. May 27 21:06:15.557277 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.557260 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 21:06:15.558212 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.558198 2566 server.go:317] "Adding debug handlers to kubelet server" May 27 21:06:15.561955 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.561937 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 21:06:15.562658 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.562628 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 21:06:15.562899 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.562884 2566 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 21:06:15.563027 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563016 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 21:06:15.563158 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563140 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 21:06:15.563241 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563220 2566 reconstruct.go:97] "Volume reconstruction finished" May 27 21:06:15.563296 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563242 2566 reconciler.go:26] "Reconciler: start to sync state" May 27 21:06:15.563560 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.563533 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 21:06:15.563648 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563634 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 21:06:15.563702 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563652 2566 factory.go:55] Registering systemd factory May 27 21:06:15.563702 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563662 2566 factory.go:223] Registration of the systemd container factory successfully May 27 21:06:15.563786 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.563677 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:15.563871 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563855 2566 factory.go:153] Registering CRI-O factory May 27 21:06:15.563871 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563870 2566 factory.go:223] Registration of the crio container factory successfully May 27 21:06:15.563871 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563888 2566 factory.go:103] Registering Raw factory May 27 21:06:15.564088 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.563906 2566 manager.go:1196] Started watching for new ooms in manager May 27 21:06:15.564577 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.564570 2566 manager.go:319] Starting recovery of all containers May 27 21:06:15.571674 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.571638 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:15.574795 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.574649 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-186.ec2.internal\" not found" node="ip-10-0-136-186.ec2.internal" May 27 21:06:15.574884 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.574664 2566 manager.go:324] Recovery completed May 27 21:06:15.580522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.580509 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.582142 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.582128 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.582196 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.582154 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.582196 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.582163 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.582583 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.582568 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 21:06:15.582583 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.582582 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 21:06:15.582659 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.582597 2566 state_mem.go:36] "Initialized new in-memory state store" May 27 21:06:15.585033 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.585017 2566 policy_none.go:49] "None policy: Start" May 27 21:06:15.585080 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.585043 2566 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 21:06:15.585080 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.585059 2566 state_mem.go:35] "Initializing new in-memory state store" May 27 21:06:15.622485 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622471 2566 manager.go:341] "Starting Device Plugin manager" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.622502 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622511 2566 server.go:85] "Starting device plugin registration server" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622697 2566 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622708 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622791 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622860 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.622870 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.623315 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 21:06:15.640662 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.623347 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:15.690840 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.690809 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 21:06:15.691972 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.691955 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 21:06:15.692057 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.691981 2566 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 21:06:15.692057 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.691997 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 21:06:15.692057 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.692003 2566 kubelet.go:2451] "Starting kubelet main sync loop" May 27 21:06:15.692057 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.692037 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 21:06:15.694728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.694701 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:15.722878 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.722837 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.724615 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.724601 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.724701 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.724630 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.724701 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.724645 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.724701 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.724672 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-186.ec2.internal" May 27 21:06:15.735091 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.735070 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-186.ec2.internal" May 27 21:06:15.735174 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.735093 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-186.ec2.internal\": node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:15.748992 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.748970 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:15.793067 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.793010 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal"] May 27 21:06:15.793132 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.793105 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.794833 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.794821 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.794896 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.794848 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.794896 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.794863 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.797196 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797184 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.797372 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797359 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:15.797409 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797386 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.797903 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797889 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.798015 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797912 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.798015 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797944 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.798015 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.797910 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.798127 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.798016 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.798127 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.798030 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.799187 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.799174 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" May 27 21:06:15.799238 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.799196 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.799885 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.799869 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.799979 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.799892 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.799979 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.799905 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.815440 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.815422 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-186.ec2.internal\" not found" node="ip-10-0-136-186.ec2.internal" May 27 21:06:15.819395 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.819382 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-186.ec2.internal\" not found" node="ip-10-0-136-186.ec2.internal" May 27 21:06:15.849691 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.849678 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:15.865488 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.865468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9e6287f4ff95ed7a7ac3b7dcc1ae2ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:15.865587 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.865502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e6287f4ff95ed7a7ac3b7dcc1ae2ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:15.865587 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.865526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d24a65f211e44ac29fef88123454ce57-config\") pod \"kube-apiserver-proxy-ip-10-0-136-186.ec2.internal\" (UID: \"d24a65f211e44ac29fef88123454ce57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" May 27 21:06:15.950029 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:15.950011 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:15.966065 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.966043 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e6287f4ff95ed7a7ac3b7dcc1ae2ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:15.966117 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.966073 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d24a65f211e44ac29fef88123454ce57-config\") pod \"kube-apiserver-proxy-ip-10-0-136-186.ec2.internal\" (UID: \"d24a65f211e44ac29fef88123454ce57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" May 27 21:06:15.966117 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.966095 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9e6287f4ff95ed7a7ac3b7dcc1ae2ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:15.966189 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.966143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9e6287f4ff95ed7a7ac3b7dcc1ae2ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:15.966189 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.966158 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d24a65f211e44ac29fef88123454ce57-config\") pod \"kube-apiserver-proxy-ip-10-0-136-186.ec2.internal\" (UID: \"d24a65f211e44ac29fef88123454ce57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" May 27 21:06:15.966189 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:15.966143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9e6287f4ff95ed7a7ac3b7dcc1ae2ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal\" (UID: \"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:16.050952 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.050897 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.118417 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.118388 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:16.122288 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.122272 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" May 27 21:06:16.151855 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.151830 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.252300 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.252277 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.352793 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.352737 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.425991 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.425970 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:16.453238 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.453219 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.472682 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.472663 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 21:06:16.472798 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.472776 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:06:16.472834 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.472777 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:06:16.472834 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.472776 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:06:16.554270 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.554247 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.555347 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.555322 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 21:01:15 +0000 UTC" deadline="2027-10-22 02:38:06.393350831 +0000 UTC" May 27 21:06:16.555398 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.555349 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12293h31m49.838004699s" May 27 21:06:16.562364 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.562345 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 21:06:16.594788 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.594770 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:06:16.618780 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.618763 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4sbcs" May 27 21:06:16.619344 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:16.619304 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24a65f211e44ac29fef88123454ce57.slice/crio-19bcc8e910c452c77084e8dbdc6beff669ad549ce865e469caedd263402abc88 WatchSource:0}: Error finding container 19bcc8e910c452c77084e8dbdc6beff669ad549ce865e469caedd263402abc88: Status 404 returned error can't find the container with id 19bcc8e910c452c77084e8dbdc6beff669ad549ce865e469caedd263402abc88 May 27 21:06:16.619535 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:16.619516 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e6287f4ff95ed7a7ac3b7dcc1ae2ab.slice/crio-1eed22b37500c2d0b879bc63a3f2db999128fd6ca3209fb0731c4c486acd95d6 WatchSource:0}: Error finding container 1eed22b37500c2d0b879bc63a3f2db999128fd6ca3209fb0731c4c486acd95d6: Status 404 returned error can't find the container with id 1eed22b37500c2d0b879bc63a3f2db999128fd6ca3209fb0731c4c486acd95d6 May 27 21:06:16.623222 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.623208 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:06:16.627513 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.627491 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4sbcs" May 27 21:06:16.655118 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.655101 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.695097 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.695060 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" event={"ID":"d24a65f211e44ac29fef88123454ce57","Type":"ContainerStarted","Data":"19bcc8e910c452c77084e8dbdc6beff669ad549ce865e469caedd263402abc88"} May 27 21:06:16.695866 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.695851 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" event={"ID":"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab","Type":"ContainerStarted","Data":"1eed22b37500c2d0b879bc63a3f2db999128fd6ca3209fb0731c4c486acd95d6"} May 27 21:06:16.756045 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:16.756024 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-186.ec2.internal\" not found" May 27 21:06:16.793389 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.793367 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:16.863399 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.863345 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" May 27 21:06:16.913078 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.913060 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:06:16.914000 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.913988 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" May 27 21:06:16.922823 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:16.922809 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:06:17.543321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.543287 2566 apiserver.go:52] "Watching apiserver" May 27 21:06:17.552728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.552704 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 21:06:17.553164 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.553140 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal","openshift-image-registry/node-ca-sw768","openshift-network-diagnostics/network-check-target-568ck","openshift-network-operator/iptables-alerter-dnfvf","openshift-ovn-kubernetes/ovnkube-node-ztbxp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92","openshift-cluster-node-tuning-operator/tuned-2cftb","openshift-dns/node-resolver-v7cwz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-wl9kv","openshift-multus/multus-xz2t6","openshift-multus/network-metrics-daemon-2ts5d","kube-system/global-pull-secret-syncer-7whx7","kube-system/konnectivity-agent-5wcrn"] May 27 21:06:17.554705 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.554680 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.557132 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.557045 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xz2t6" May 27 21:06:17.557246 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.557145 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 21:06:17.557246 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.557184 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6l2vq\"" May 27 21:06:17.557378 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.557363 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 21:06:17.558546 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.558428 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:17.558546 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.558515 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:17.558546 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.558534 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.559189 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.559169 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 21:06:17.559325 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.559309 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 21:06:17.559545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.559523 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p8q89\"" May 27 21:06:17.559665 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.559526 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 21:06:17.559991 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.559844 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 21:06:17.560729 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.560691 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 21:06:17.560835 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.560757 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 21:06:17.560835 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.560789 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 21:06:17.561129 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.561113 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fwnbj\"" May 27 21:06:17.561472 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.561453 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.561558 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.561534 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.563026 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.563007 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.563804 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.563785 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 21:06:17.563898 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.563788 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 21:06:17.563898 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.563846 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rrrbw\"" May 27 21:06:17.564097 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.564076 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6n97w\"" May 27 21:06:17.564691 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.564675 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.565090 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565008 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 21:06:17.565090 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565069 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 21:06:17.565254 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565073 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 21:06:17.565254 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565073 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 21:06:17.565435 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565418 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 21:06:17.565525 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565503 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 21:06:17.565593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565535 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tnn7p\"" May 27 21:06:17.565783 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565767 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 21:06:17.565887 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.565788 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 21:06:17.566477 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.566163 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 21:06:17.566477 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.566427 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.566885 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.566866 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkn42\"" May 27 21:06:17.567840 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.567818 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.568872 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.568617 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 21:06:17.569345 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.569192 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 21:06:17.569345 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.569212 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 21:06:17.570231 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.570214 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:17.570363 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.570346 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:17.570421 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.570382 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f7wpc\"" May 27 21:06:17.571559 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.570761 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 21:06:17.571559 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.571084 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 21:06:17.571559 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.571405 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-74lh2\"" May 27 21:06:17.572306 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.572251 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 21:06:17.573005 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.572974 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.573089 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573058 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 21:06:17.573197 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-cni-bin\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.573358 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-env-overrides\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.573358 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.573313 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:17.573358 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573322 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovnkube-script-lib\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.573548 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-host-slash\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.573548 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0dbdf25-c120-422a-b5ed-e2787733801d-hosts-file\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.573548 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4m7j\" (UniqueName: \"kubernetes.io/projected/c0dbdf25-c120-422a-b5ed-e2787733801d-kube-api-access-h4m7j\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.573880 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-kubelet\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574027 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-systemd\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.574027 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-host\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.574027 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-cnibin\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.574027 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.573995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-socket-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.574027 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-systemd\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovnkube-config\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574216 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-system-cni-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-os-release\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-cni-multus\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.574287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-kubernetes\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-var-lib-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-etc-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbbj\" (UniqueName: \"kubernetes.io/projected/23b86d35-2631-4860-a54e-6dfc1da738f8-kube-api-access-xzbbj\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-slash\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e66f5cb-adf7-47b0-a958-fa151bc78044-tmp\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-tuned\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-sys-fs\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dbdf25-c120-422a-b5ed-e2787733801d-tmp-dir\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.574595 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovn-node-metrics-cert\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-hostroot\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-daemon-config\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-multus-certs\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-registration-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-kubelet\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-ovn\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574816 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-cni-netd\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysctl-d\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-run\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/488f66be-50d6-4b6d-8562-af99bc8c5500-konnectivity-ca\") pod \"konnectivity-agent-5wcrn\" (UID: \"488f66be-50d6-4b6d-8562-af99bc8c5500\") " pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-lib-modules\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.575025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.574989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqjjr\" (UniqueName: \"kubernetes.io/projected/2e66f5cb-adf7-47b0-a958-fa151bc78044-kube-api-access-hqjjr\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-cni-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-etc-kubernetes\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-socket-dir-parent\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-k8s-cni-cncf-io\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/488f66be-50d6-4b6d-8562-af99bc8c5500-agent-certs\") pod \"konnectivity-agent-5wcrn\" (UID: \"488f66be-50d6-4b6d-8562-af99bc8c5500\") " pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575249 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-modprobe-d\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575273 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-systemd-units\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4fvv\" (UniqueName: \"kubernetes.io/projected/9c73bd75-c52d-48b5-81ea-30c402efbfe6-kube-api-access-h4fvv\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575322 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d269653-f5ca-4b41-a94f-b7258af6a4d4-cni-binary-copy\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-cni-bin\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6zpk\" (UniqueName: \"kubernetes.io/projected/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-kube-api-access-t6zpk\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-var-lib-kubelet\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-netns\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.575619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-run-netns\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575512 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-node-log\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-sys\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-conf-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-device-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysconfig\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-log-socket\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysctl-conf\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjx8s\" (UniqueName: \"kubernetes.io/projected/7d269653-f5ca-4b41-a94f-b7258af6a4d4-kube-api-access-wjx8s\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.576272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.575762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-iptables-alerter-script\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.628884 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.628843 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:01:16 +0000 UTC" deadline="2027-12-17 04:00:09.158786604 +0000 UTC" May 27 21:06:17.628884 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.628870 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13638h53m51.529920293s" May 27 21:06:17.664171 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.664152 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 21:06:17.676461 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676439 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-kubelet\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.676558 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676465 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-ovn\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.676558 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-cni-netd\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.676558 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676520 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676557 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysctl-d\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676561 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-kubelet\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-run\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-cni-netd\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676528 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-ovn\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-os-release\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.676668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f858b472-d81f-4a62-978b-0df92a5dd499-dbus\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676667 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-run\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676679 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/488f66be-50d6-4b6d-8562-af99bc8c5500-konnectivity-ca\") pod \"konnectivity-agent-5wcrn\" (UID: \"488f66be-50d6-4b6d-8562-af99bc8c5500\") " pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-lib-modules\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676710 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqjjr\" (UniqueName: \"kubernetes.io/projected/2e66f5cb-adf7-47b0-a958-fa151bc78044-kube-api-access-hqjjr\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysctl-d\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-cni-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676774 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-etc-kubernetes\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676787 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-cni-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676805 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-socket-dir-parent\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676832 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676870 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-lib-modules\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.676930 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676961 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.676990 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-k8s-cni-cncf-io\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677014 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/488f66be-50d6-4b6d-8562-af99bc8c5500-agent-certs\") pod \"konnectivity-agent-5wcrn\" (UID: \"488f66be-50d6-4b6d-8562-af99bc8c5500\") " pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677038 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-modprobe-d\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-etc-kubernetes\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677075 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-socket-dir-parent\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677078 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-systemd-units\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-serviceca\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677131 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4fvv\" (UniqueName: \"kubernetes.io/projected/9c73bd75-c52d-48b5-81ea-30c402efbfe6-kube-api-access-h4fvv\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677157 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d269653-f5ca-4b41-a94f-b7258af6a4d4-cni-binary-copy\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-modprobe-d\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-k8s-cni-cncf-io\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-cni-bin\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/488f66be-50d6-4b6d-8562-af99bc8c5500-konnectivity-ca\") pod \"konnectivity-agent-5wcrn\" (UID: \"488f66be-50d6-4b6d-8562-af99bc8c5500\") " pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677213 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6zpk\" (UniqueName: \"kubernetes.io/projected/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-kube-api-access-t6zpk\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677240 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-var-lib-kubelet\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.677365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-netns\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-cni-bin\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-var-lib-kubelet\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677380 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-netns\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677411 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677401 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677287 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677446 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-systemd-units\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677462 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-run-netns\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677489 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-node-log\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677510 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-sys\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-run-netns\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677544 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-node-log\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677594 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-conf-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-sys\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-conf-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677685 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d269653-f5ca-4b41-a94f-b7258af6a4d4-cni-binary-copy\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677704 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-device-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.678140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677745 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysconfig\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677760 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-device-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677770 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-log-socket\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677796 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysctl-conf\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677821 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjx8s\" (UniqueName: \"kubernetes.io/projected/7d269653-f5ca-4b41-a94f-b7258af6a4d4-kube-api-access-wjx8s\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677836 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysconfig\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-log-socket\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677848 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-iptables-alerter-script\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677957 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-cni-bin\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677976 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-env-overrides\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.677990 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovnkube-script-lib\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678006 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-host-slash\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678027 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0dbdf25-c120-422a-b5ed-e2787733801d-hosts-file\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678044 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4m7j\" (UniqueName: \"kubernetes.io/projected/c0dbdf25-c120-422a-b5ed-e2787733801d-kube-api-access-h4m7j\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678078 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-kubelet\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-systemd\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.678892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-host\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678130 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-cnibin\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678146 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-socket-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbvz\" (UniqueName: \"kubernetes.io/projected/c90bff16-1226-4f69-acdc-f51c55cdca9a-kube-api-access-ntbvz\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678187 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-systemd\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovnkube-config\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678233 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678255 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-system-cni-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678270 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-os-release\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678285 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-cni-multus\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-kubelet\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678302 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-kubernetes\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678328 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-var-lib-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-cni-bin\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678356 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-etc-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-iptables-alerter-script\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.679692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-etc-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678005 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-sysctl-conf\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-system-cni-dir\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-cnibin\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-os-release\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678610 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-systemd\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-kubernetes\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-var-lib-cni-multus\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678633 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-var-lib-openvswitch\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e66f5cb-adf7-47b0-a958-fa151bc78044-host\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-host-slash\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-run-systemd\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-socket-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678785 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbbj\" (UniqueName: \"kubernetes.io/projected/23b86d35-2631-4860-a54e-6dfc1da738f8-kube-api-access-xzbbj\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678810 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-slash\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678834 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e66f5cb-adf7-47b0-a958-fa151bc78044-tmp\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.680270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c73bd75-c52d-48b5-81ea-30c402efbfe6-host-slash\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz5xb\" (UniqueName: \"kubernetes.io/projected/eb39e458-d2d6-4bb3-bf78-ef0e06839905-kube-api-access-rz5xb\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.678978 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-tuned\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679003 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-sys-fs\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679044 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dbdf25-c120-422a-b5ed-e2787733801d-tmp-dir\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovnkube-config\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-cnibin\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovnkube-script-lib\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679107 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-sys-fs\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679145 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f858b472-d81f-4a62-978b-0df92a5dd499-kubelet-config\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0dbdf25-c120-422a-b5ed-e2787733801d-hosts-file\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679174 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovn-node-metrics-cert\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-hostroot\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbj7h\" (UniqueName: \"kubernetes.io/projected/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-kube-api-access-lbj7h\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-system-cni-dir\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.681008 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dbdf25-c120-422a-b5ed-e2787733801d-tmp-dir\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679343 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-daemon-config\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679428 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-multus-certs\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679456 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-registration-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-host\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-host-run-multus-certs\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679603 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/23b86d35-2631-4860-a54e-6dfc1da738f8-registration-dir\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d269653-f5ca-4b41-a94f-b7258af6a4d4-hostroot\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c73bd75-c52d-48b5-81ea-30c402efbfe6-env-overrides\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.679748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d269653-f5ca-4b41-a94f-b7258af6a4d4-multus-daemon-config\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.680995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/488f66be-50d6-4b6d-8562-af99bc8c5500-agent-certs\") pod \"konnectivity-agent-5wcrn\" (UID: \"488f66be-50d6-4b6d-8562-af99bc8c5500\") " pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.681232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e66f5cb-adf7-47b0-a958-fa151bc78044-etc-tuned\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.681539 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.681287 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e66f5cb-adf7-47b0-a958-fa151bc78044-tmp\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.682031 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.681892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c73bd75-c52d-48b5-81ea-30c402efbfe6-ovn-node-metrics-cert\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.683029 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.682986 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:17.683112 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.683034 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:17.683112 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.683047 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:17.683291 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.683140 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:06:18.183104052 +0000 UTC m=+3.033553110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:17.685047 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.685025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6zpk\" (UniqueName: \"kubernetes.io/projected/683b1f9c-1f9f-4cd4-974a-11c4cf7a6801-kube-api-access-t6zpk\") pod \"iptables-alerter-dnfvf\" (UID: \"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801\") " pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.685683 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.685650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqjjr\" (UniqueName: \"kubernetes.io/projected/2e66f5cb-adf7-47b0-a958-fa151bc78044-kube-api-access-hqjjr\") pod \"tuned-2cftb\" (UID: \"2e66f5cb-adf7-47b0-a958-fa151bc78044\") " pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.685975 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.685954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4fvv\" (UniqueName: \"kubernetes.io/projected/9c73bd75-c52d-48b5-81ea-30c402efbfe6-kube-api-access-h4fvv\") pod \"ovnkube-node-ztbxp\" (UID: \"9c73bd75-c52d-48b5-81ea-30c402efbfe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.689392 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.688507 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbbj\" (UniqueName: \"kubernetes.io/projected/23b86d35-2631-4860-a54e-6dfc1da738f8-kube-api-access-xzbbj\") pod \"aws-ebs-csi-driver-node-c5z92\" (UID: \"23b86d35-2631-4860-a54e-6dfc1da738f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.690383 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.690360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4m7j\" (UniqueName: \"kubernetes.io/projected/c0dbdf25-c120-422a-b5ed-e2787733801d-kube-api-access-h4m7j\") pod \"node-resolver-v7cwz\" (UID: \"c0dbdf25-c120-422a-b5ed-e2787733801d\") " pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.690614 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.690592 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjx8s\" (UniqueName: \"kubernetes.io/projected/7d269653-f5ca-4b41-a94f-b7258af6a4d4-kube-api-access-wjx8s\") pod \"multus-xz2t6\" (UID: \"7d269653-f5ca-4b41-a94f-b7258af6a4d4\") " pod="openshift-multus/multus-xz2t6" May 27 21:06:17.779897 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.779867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.780092 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.779933 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbvz\" (UniqueName: \"kubernetes.io/projected/c90bff16-1226-4f69-acdc-f51c55cdca9a-kube-api-access-ntbvz\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780092 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.779967 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780092 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.779989 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rz5xb\" (UniqueName: \"kubernetes.io/projected/eb39e458-d2d6-4bb3-bf78-ef0e06839905-kube-api-access-rz5xb\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:17.780092 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.780039 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.780120 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:18.280096953 +0000 UTC m=+3.130545994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780145 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-cnibin\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780178 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780204 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f858b472-d81f-4a62-978b-0df92a5dd499-kubelet-config\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780235 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbj7h\" (UniqueName: \"kubernetes.io/projected/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-kube-api-access-lbj7h\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780265 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-system-cni-dir\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f858b472-d81f-4a62-978b-0df92a5dd499-kubelet-config\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.780326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-cnibin\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-system-cni-dir\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780294 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780371 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780383 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-host\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-host\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780423 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-os-release\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780445 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f858b472-d81f-4a62-978b-0df92a5dd499-dbus\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c90bff16-1226-4f69-acdc-f51c55cdca9a-os-release\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780511 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780514 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780551 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-serviceca\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.780580 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:17.780635 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:18.280619383 +0000 UTC m=+3.131068427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f858b472-d81f-4a62-978b-0df92a5dd499-dbus\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:17.780715 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780719 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.781389 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c90bff16-1226-4f69-acdc-f51c55cdca9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.781389 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.780994 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-serviceca\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.789575 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.789549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbvz\" (UniqueName: \"kubernetes.io/projected/c90bff16-1226-4f69-acdc-f51c55cdca9a-kube-api-access-ntbvz\") pod \"multus-additional-cni-plugins-wl9kv\" (UID: \"c90bff16-1226-4f69-acdc-f51c55cdca9a\") " pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.789893 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.789851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbj7h\" (UniqueName: \"kubernetes.io/projected/0dc2df21-ae9a-44cc-9ae1-c6495f563ff4-kube-api-access-lbj7h\") pod \"node-ca-sw768\" (UID: \"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4\") " pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.789893 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.789887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz5xb\" (UniqueName: \"kubernetes.io/projected/eb39e458-d2d6-4bb3-bf78-ef0e06839905-kube-api-access-rz5xb\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:17.867061 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.866995 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2cftb" May 27 21:06:17.875596 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.875572 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xz2t6" May 27 21:06:17.884865 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.884842 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnfvf" May 27 21:06:17.891345 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.891328 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" May 27 21:06:17.896948 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.896930 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:17.903513 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.903489 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:17.908976 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.908958 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v7cwz" May 27 21:06:17.915477 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.915463 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sw768" May 27 21:06:17.919991 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.919970 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" May 27 21:06:17.999329 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:17.999304 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:18.030019 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.029997 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:18.183311 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.183247 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:18.183435 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.183396 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:18.183435 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.183410 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:18.183435 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.183418 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:18.183531 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.183470 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:06:19.183456461 +0000 UTC m=+4.033905502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:18.214485 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.214438 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b86d35_2631_4860_a54e_6dfc1da738f8.slice/crio-c2adfd9f916618abf2f03ca33f99feeccca1e00e3d4e9fc7f297f014aab6331f WatchSource:0}: Error finding container c2adfd9f916618abf2f03ca33f99feeccca1e00e3d4e9fc7f297f014aab6331f: Status 404 returned error can't find the container with id c2adfd9f916618abf2f03ca33f99feeccca1e00e3d4e9fc7f297f014aab6331f May 27 21:06:18.216041 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.216018 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c73bd75_c52d_48b5_81ea_30c402efbfe6.slice/crio-fbb22dd32ee1dfc35ced1822e7d4c06c798584a74cd9c92e99a6f7e0cf7df0c2 WatchSource:0}: Error finding container fbb22dd32ee1dfc35ced1822e7d4c06c798584a74cd9c92e99a6f7e0cf7df0c2: Status 404 returned error can't find the container with id fbb22dd32ee1dfc35ced1822e7d4c06c798584a74cd9c92e99a6f7e0cf7df0c2 May 27 21:06:18.219777 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.219752 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d269653_f5ca_4b41_a94f_b7258af6a4d4.slice/crio-82decdb7cd8a24fc60a5a519be59db0ce23ff23652a009bb99fdc2033d435ba4 WatchSource:0}: Error finding container 82decdb7cd8a24fc60a5a519be59db0ce23ff23652a009bb99fdc2033d435ba4: Status 404 returned error can't find the container with id 82decdb7cd8a24fc60a5a519be59db0ce23ff23652a009bb99fdc2033d435ba4 May 27 21:06:18.220841 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.220817 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488f66be_50d6_4b6d_8562_af99bc8c5500.slice/crio-9dec5f71fca145b3309ac0680df79ca783e57003daf7b93381f0a45bf61b7916 WatchSource:0}: Error finding container 9dec5f71fca145b3309ac0680df79ca783e57003daf7b93381f0a45bf61b7916: Status 404 returned error can't find the container with id 9dec5f71fca145b3309ac0680df79ca783e57003daf7b93381f0a45bf61b7916 May 27 21:06:18.221468 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.221322 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0dbdf25_c120_422a_b5ed_e2787733801d.slice/crio-d5fd36792d949126c7b90b6e5cb6035edb2387019b690758eb8ed62c354b73d2 WatchSource:0}: Error finding container d5fd36792d949126c7b90b6e5cb6035edb2387019b690758eb8ed62c354b73d2: Status 404 returned error can't find the container with id d5fd36792d949126c7b90b6e5cb6035edb2387019b690758eb8ed62c354b73d2 May 27 21:06:18.222819 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.222753 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90bff16_1226_4f69_acdc_f51c55cdca9a.slice/crio-15026158c73e58f921586f13f0a35761cb9aad0b79eb5647bd8a7f71daa7771d WatchSource:0}: Error finding container 15026158c73e58f921586f13f0a35761cb9aad0b79eb5647bd8a7f71daa7771d: Status 404 returned error can't find the container with id 15026158c73e58f921586f13f0a35761cb9aad0b79eb5647bd8a7f71daa7771d May 27 21:06:18.223224 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.223087 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683b1f9c_1f9f_4cd4_974a_11c4cf7a6801.slice/crio-40e55beb4977b249e92e04e20ca2ed4167071dad7fde15fffb067431d2231013 WatchSource:0}: Error finding container 40e55beb4977b249e92e04e20ca2ed4167071dad7fde15fffb067431d2231013: Status 404 returned error can't find the container with id 40e55beb4977b249e92e04e20ca2ed4167071dad7fde15fffb067431d2231013 May 27 21:06:18.225461 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.225437 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc2df21_ae9a_44cc_9ae1_c6495f563ff4.slice/crio-1ba6067083f720a431ae71b1cb2e8ff6240832821ba26bae0ea1bd329528db10 WatchSource:0}: Error finding container 1ba6067083f720a431ae71b1cb2e8ff6240832821ba26bae0ea1bd329528db10: Status 404 returned error can't find the container with id 1ba6067083f720a431ae71b1cb2e8ff6240832821ba26bae0ea1bd329528db10 May 27 21:06:18.227313 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:06:18.227272 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e66f5cb_adf7_47b0_a958_fa151bc78044.slice/crio-d7821d667572c5e9676f089ff20cbbeb3a6505cc03731ac7de46e41ccdea800a WatchSource:0}: Error finding container d7821d667572c5e9676f089ff20cbbeb3a6505cc03731ac7de46e41ccdea800a: Status 404 returned error can't find the container with id d7821d667572c5e9676f089ff20cbbeb3a6505cc03731ac7de46e41ccdea800a May 27 21:06:18.283982 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.283845 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:18.284085 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.283993 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:18.284085 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.284016 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:18.284085 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.284052 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:19.284033258 +0000 UTC m=+4.134482297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:18.284219 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.284090 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:18.284219 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.284128 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:19.284116962 +0000 UTC m=+4.134565996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:18.630118 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.629968 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:01:16 +0000 UTC" deadline="2028-02-26 12:09:42.63842037 +0000 UTC" May 27 21:06:18.630118 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.630004 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15351h3m24.008419844s" May 27 21:06:18.693553 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.693528 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:18.693717 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:18.693644 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:18.702274 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.702243 2566 generic.go:358] "Generic (PLEG): container finished" podID="a9e6287f4ff95ed7a7ac3b7dcc1ae2ab" containerID="7bb2a354245acef54cb7f8328e6eb1fbf52b55705deed5c93f6ae53023a67458" exitCode=0 May 27 21:06:18.702401 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.702324 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" event={"ID":"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab","Type":"ContainerDied","Data":"7bb2a354245acef54cb7f8328e6eb1fbf52b55705deed5c93f6ae53023a67458"} May 27 21:06:18.708315 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.707808 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" event={"ID":"d24a65f211e44ac29fef88123454ce57","Type":"ContainerStarted","Data":"cd32b924587e3223559aa52b44731bcfac4c2a844ac7e21746a563b38719a97d"} May 27 21:06:18.713941 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.713873 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2cftb" event={"ID":"2e66f5cb-adf7-47b0-a958-fa151bc78044","Type":"ContainerStarted","Data":"d7821d667572c5e9676f089ff20cbbeb3a6505cc03731ac7de46e41ccdea800a"} May 27 21:06:18.719825 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.719798 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"fbb22dd32ee1dfc35ced1822e7d4c06c798584a74cd9c92e99a6f7e0cf7df0c2"} May 27 21:06:18.723113 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.723090 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" event={"ID":"23b86d35-2631-4860-a54e-6dfc1da738f8","Type":"ContainerStarted","Data":"c2adfd9f916618abf2f03ca33f99feeccca1e00e3d4e9fc7f297f014aab6331f"} May 27 21:06:18.725167 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.725144 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sw768" event={"ID":"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4","Type":"ContainerStarted","Data":"1ba6067083f720a431ae71b1cb2e8ff6240832821ba26bae0ea1bd329528db10"} May 27 21:06:18.733994 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.733967 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnfvf" event={"ID":"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801","Type":"ContainerStarted","Data":"40e55beb4977b249e92e04e20ca2ed4167071dad7fde15fffb067431d2231013"} May 27 21:06:18.741844 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.741824 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerStarted","Data":"15026158c73e58f921586f13f0a35761cb9aad0b79eb5647bd8a7f71daa7771d"} May 27 21:06:18.745305 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.745284 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v7cwz" event={"ID":"c0dbdf25-c120-422a-b5ed-e2787733801d","Type":"ContainerStarted","Data":"d5fd36792d949126c7b90b6e5cb6035edb2387019b690758eb8ed62c354b73d2"} May 27 21:06:18.756331 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.756304 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5wcrn" event={"ID":"488f66be-50d6-4b6d-8562-af99bc8c5500","Type":"ContainerStarted","Data":"9dec5f71fca145b3309ac0680df79ca783e57003daf7b93381f0a45bf61b7916"} May 27 21:06:18.775938 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:18.772972 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xz2t6" event={"ID":"7d269653-f5ca-4b41-a94f-b7258af6a4d4","Type":"ContainerStarted","Data":"82decdb7cd8a24fc60a5a519be59db0ce23ff23652a009bb99fdc2033d435ba4"} May 27 21:06:19.193546 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.192839 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:19.193546 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.193054 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:19.193546 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.193072 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:19.193546 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.193084 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:19.193546 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.193141 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:06:21.193123953 +0000 UTC m=+6.043572995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:19.293688 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.293642 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:19.293846 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.293731 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:19.293901 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.293864 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:19.294012 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.293937 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:21.293903786 +0000 UTC m=+6.144352835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:19.294331 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.294313 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:19.294396 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.294367 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:21.294351449 +0000 UTC m=+6.144800487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:19.498165 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.498088 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:19.692960 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.692452 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:19.692960 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.692604 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:19.693696 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.693548 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:19.693696 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:19.693660 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:19.794082 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.793984 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" event={"ID":"a9e6287f4ff95ed7a7ac3b7dcc1ae2ab","Type":"ContainerStarted","Data":"c3f6c205224db2cf8a29367d2bd136bf891d0350e94bddb55d4ec3108f889d5c"} May 27 21:06:19.809830 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:19.809768 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-186.ec2.internal" podStartSLOduration=3.809749946 podStartE2EDuration="3.809749946s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:06:18.729123018 +0000 UTC m=+3.579572078" watchObservedRunningTime="2026-05-27 21:06:19.809749946 +0000 UTC m=+4.660199005" May 27 21:06:20.693274 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:20.693207 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:20.693743 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:20.693337 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:21.209750 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:21.209360 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:21.209750 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.209518 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:21.209750 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.209540 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:21.209750 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.209553 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:21.209750 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.209616 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:06:25.209598467 +0000 UTC m=+10.060047505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:21.311151 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:21.310772 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:21.311151 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:21.310854 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:21.311151 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.310984 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:21.311151 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.311052 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:21.311151 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.311057 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:25.311039017 +0000 UTC m=+10.161488067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:21.311151 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.311133 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:25.311117342 +0000 UTC m=+10.161566380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:21.696657 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:21.696582 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:21.697120 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.696708 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:21.697191 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:21.697118 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:21.697242 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:21.697221 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:22.692963 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:22.692913 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:22.693133 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:22.693055 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:23.692247 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:23.692211 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:23.692696 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:23.692358 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:23.692821 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:23.692802 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:23.692951 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:23.692910 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:24.693030 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:24.692990 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:24.693468 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:24.693150 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:25.244939 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:25.244886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:25.245187 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.245123 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:25.245187 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.245140 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:25.245187 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.245154 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:25.245345 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.245222 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:06:33.2452031 +0000 UTC m=+18.095652151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:25.346141 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:25.345834 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:25.346141 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:25.345916 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:25.346141 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.346006 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:25.346141 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.346061 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:25.346141 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.346084 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:33.346061503 +0000 UTC m=+18.196510557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:25.346141 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.346114 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:33.346097976 +0000 UTC m=+18.196547019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:25.693938 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:25.693846 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:25.693938 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:25.693899 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:25.694392 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.694020 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:25.694392 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:25.694108 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:26.692757 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:26.692721 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:26.692962 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:26.692840 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:27.693202 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:27.693166 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:27.693661 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:27.693313 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:27.693661 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:27.693386 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:27.693661 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:27.693508 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:28.692241 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:28.692169 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:28.692371 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:28.692274 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:29.692501 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:29.692464 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:29.692959 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:29.692464 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:29.692959 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:29.692585 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:29.692959 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:29.692660 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:30.693150 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:30.693120 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:30.693617 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:30.693237 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:31.692787 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:31.692756 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:31.692978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:31.692762 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:31.692978 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:31.692891 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:31.692978 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:31.692934 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:32.692327 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:32.692292 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:32.692798 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:32.692412 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:33.310223 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:33.310188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:33.310409 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.310366 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:33.310409 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.310392 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:33.310409 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.310405 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:33.310552 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.310470 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:06:49.31045088 +0000 UTC m=+34.160899917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:33.410514 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:33.410482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:33.410683 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:33.410537 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:33.410683 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.410632 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:33.410839 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.410686 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:49.410672105 +0000 UTC m=+34.261121143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:33.410839 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.410632 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:33.410839 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.410728 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:49.410717929 +0000 UTC m=+34.261166964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:33.692648 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:33.692568 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:33.693103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:33.692571 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:33.693103 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.692715 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:33.693103 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:33.692783 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:34.692189 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:34.692151 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:34.692338 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:34.692261 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:35.693120 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:35.693082 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:35.693570 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:35.693206 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:35.693570 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:35.693256 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:35.693570 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:35.693348 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:36.692673 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.692517 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:36.692760 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:36.692735 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:36.823652 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.823573 2566 generic.go:358] "Generic (PLEG): container finished" podID="c90bff16-1226-4f69-acdc-f51c55cdca9a" containerID="5cf536c3e51fd5c035d6d1162ca797a2d025997bf7bea66c6c576cda2d79a7a4" exitCode=0 May 27 21:06:36.824081 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.823666 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerDied","Data":"5cf536c3e51fd5c035d6d1162ca797a2d025997bf7bea66c6c576cda2d79a7a4"} May 27 21:06:36.825061 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.825025 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v7cwz" event={"ID":"c0dbdf25-c120-422a-b5ed-e2787733801d","Type":"ContainerStarted","Data":"b28163eed94affff5e745752758b2177ff949fcfdc921949a5c73f3979813639"} May 27 21:06:36.826334 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.826310 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5wcrn" event={"ID":"488f66be-50d6-4b6d-8562-af99bc8c5500","Type":"ContainerStarted","Data":"33c1cbf56f642a9959a11d83f46283b66e779826d4dab8b6153b48fd89434e89"} May 27 21:06:36.827829 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.827798 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xz2t6" event={"ID":"7d269653-f5ca-4b41-a94f-b7258af6a4d4","Type":"ContainerStarted","Data":"24d3d745688b7eda3cc7e8b3bc20f295d044cb67b950845a7f200c9ff34f6f1a"} May 27 21:06:36.829261 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.829227 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2cftb" event={"ID":"2e66f5cb-adf7-47b0-a958-fa151bc78044","Type":"ContainerStarted","Data":"97ec73a11a56b65be89eae2066271dab672ccce19b211fdc7f8785ea778915e5"} May 27 21:06:36.830565 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.830547 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" event={"ID":"23b86d35-2631-4860-a54e-6dfc1da738f8","Type":"ContainerStarted","Data":"8a521d81bc795a2fcfae83a8fbd6ee11530d600262681ed63096c8bdae091160"} May 27 21:06:36.831775 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.831757 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sw768" event={"ID":"0dc2df21-ae9a-44cc-9ae1-c6495f563ff4","Type":"ContainerStarted","Data":"10d05ce0b534dcab8838c951bdc6958443e1a88b06c5dbec661d65b865a7ac0d"} May 27 21:06:36.843683 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.843649 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-186.ec2.internal" podStartSLOduration=20.843638947 podStartE2EDuration="20.843638947s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:06:19.810554015 +0000 UTC m=+4.661003074" watchObservedRunningTime="2026-05-27 21:06:36.843638947 +0000 UTC m=+21.694088004" May 27 21:06:36.857983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.857952 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-v7cwz" podStartSLOduration=3.789028492 podStartE2EDuration="21.857942066s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.224381312 +0000 UTC m=+3.074830347" lastFinishedPulling="2026-05-27 21:06:36.293294886 +0000 UTC m=+21.143743921" observedRunningTime="2026-05-27 21:06:36.857865373 +0000 UTC m=+21.708314430" watchObservedRunningTime="2026-05-27 21:06:36.857942066 +0000 UTC m=+21.708391123" May 27 21:06:36.870792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.870761 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sw768" podStartSLOduration=3.805113962 podStartE2EDuration="21.8707514s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.227673417 +0000 UTC m=+3.078122452" lastFinishedPulling="2026-05-27 21:06:36.293310854 +0000 UTC m=+21.143759890" observedRunningTime="2026-05-27 21:06:36.870314857 +0000 UTC m=+21.720763914" watchObservedRunningTime="2026-05-27 21:06:36.8707514 +0000 UTC m=+21.721200454" May 27 21:06:36.886928 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.886889 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5wcrn" podStartSLOduration=3.845534991 podStartE2EDuration="21.886883204s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.224042395 +0000 UTC m=+3.074491445" lastFinishedPulling="2026-05-27 21:06:36.265390623 +0000 UTC m=+21.115839658" observedRunningTime="2026-05-27 21:06:36.886602536 +0000 UTC m=+21.737051593" watchObservedRunningTime="2026-05-27 21:06:36.886883204 +0000 UTC m=+21.737332262" May 27 21:06:36.914725 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.914693 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2cftb" podStartSLOduration=3.832575264 podStartE2EDuration="21.914683609s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.230097747 +0000 UTC m=+3.080546793" lastFinishedPulling="2026-05-27 21:06:36.312206085 +0000 UTC m=+21.162655138" observedRunningTime="2026-05-27 21:06:36.899968513 +0000 UTC m=+21.750417572" watchObservedRunningTime="2026-05-27 21:06:36.914683609 +0000 UTC m=+21.765132719" May 27 21:06:36.914879 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:36.914858 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xz2t6" podStartSLOduration=3.794284615 podStartE2EDuration="21.914854516s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.221560737 +0000 UTC m=+3.072009773" lastFinishedPulling="2026-05-27 21:06:36.342130639 +0000 UTC m=+21.192579674" observedRunningTime="2026-05-27 21:06:36.91457771 +0000 UTC m=+21.765026767" watchObservedRunningTime="2026-05-27 21:06:36.914854516 +0000 UTC m=+21.765303588" May 27 21:06:37.692335 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.692150 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:37.692437 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.692194 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:37.692437 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:37.692417 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:37.692549 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:37.692494 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:37.835603 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:06:37.836271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835859 2566 generic.go:358] "Generic (PLEG): container finished" podID="9c73bd75-c52d-48b5-81ea-30c402efbfe6" containerID="20e59f3bface4afc7424b01a9b413ab9f1f24cd86d045dc239873ef6a76d56e1" exitCode=1 May 27 21:06:37.836271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835936 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"4f6ae716c1bdc03bece84c386637240c965e31e9f5e88953e982af59bc366b56"} May 27 21:06:37.836271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835963 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"1364707213ee30ce1582032bdcc21f61ffef41cc8235fc210b372249e337c2c8"} May 27 21:06:37.836271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835974 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"97fd82b173a72ea397752260c294489c8d4277e8b0dd592bbfab99382048f660"} May 27 21:06:37.836271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835982 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerDied","Data":"20e59f3bface4afc7424b01a9b413ab9f1f24cd86d045dc239873ef6a76d56e1"} May 27 21:06:37.836271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.835993 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"b25eee8035b7b50e8aee253d6a1dd6f929ff2333fcc103cc998d20f8044b8236"} May 27 21:06:37.837482 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.837453 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnfvf" event={"ID":"683b1f9c-1f9f-4cd4-974a-11c4cf7a6801","Type":"ContainerStarted","Data":"ae81facbdfd7eaf7129f14b6c5e308b6ce7371c1304adde1f28c611a3128edef"} May 27 21:06:37.852038 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.852001 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dnfvf" podStartSLOduration=4.766896777 podStartE2EDuration="22.851987155s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.227117264 +0000 UTC m=+3.077566302" lastFinishedPulling="2026-05-27 21:06:36.312207636 +0000 UTC m=+21.162656680" observedRunningTime="2026-05-27 21:06:37.851519088 +0000 UTC m=+22.701968144" watchObservedRunningTime="2026-05-27 21:06:37.851987155 +0000 UTC m=+22.702436216" May 27 21:06:37.892532 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:37.892503 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 21:06:38.637010 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.636880 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T21:06:37.892519689Z","UUID":"0b9ea004-2cff-4c98-9434-e547d029d924","Handler":null,"Name":"","Endpoint":""} May 27 21:06:38.639593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.639571 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 21:06:38.639593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.639597 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 21:06:38.693103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.693076 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:38.693227 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:38.693210 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:38.842479 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.842459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:06:38.842883 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.842860 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"d6352eb6e4586e8a29fb1baa65e711756b9b315b5e1a127ce4a59a9477931b33"} May 27 21:06:38.844763 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:38.844735 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" event={"ID":"23b86d35-2631-4860-a54e-6dfc1da738f8","Type":"ContainerStarted","Data":"d6f454d2d250881978eb4fcfdcbaaaf3d5cfceaf23b9137798b855f7c9f4a444"} May 27 21:06:39.693276 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:39.693217 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:39.693276 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:39.693247 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:39.693530 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:39.693356 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:39.693530 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:39.693436 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:39.848406 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:39.848355 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" event={"ID":"23b86d35-2631-4860-a54e-6dfc1da738f8","Type":"ContainerStarted","Data":"b4543a65874aeb15b8894904ca47503623bd7400600c09a4ff0ec988db1c71a1"} May 27 21:06:40.575823 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.575608 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:40.576246 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.576222 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:40.594173 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.594126 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z92" podStartSLOduration=5.062950365 podStartE2EDuration="25.594110327s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.21859416 +0000 UTC m=+3.069043196" lastFinishedPulling="2026-05-27 21:06:38.74975411 +0000 UTC m=+23.600203158" observedRunningTime="2026-05-27 21:06:39.869376319 +0000 UTC m=+24.719825380" watchObservedRunningTime="2026-05-27 21:06:40.594110327 +0000 UTC m=+25.444559388" May 27 21:06:40.692712 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.692688 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:40.692866 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:40.692799 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:40.853050 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.852983 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:06:40.853556 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.853432 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"abd13624c4dd7b28a892c6975bf739daa0551f814f49ae3e36ff566b8fe20201"} May 27 21:06:40.853705 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.853682 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:40.854243 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:40.854224 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5wcrn" May 27 21:06:41.693142 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:41.693067 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:41.693297 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:41.693067 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:41.693297 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:41.693173 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:41.693297 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:41.693266 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:42.692367 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.692146 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:42.692990 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:42.692366 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:42.859778 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.859744 2566 generic.go:358] "Generic (PLEG): container finished" podID="c90bff16-1226-4f69-acdc-f51c55cdca9a" containerID="d71c9c090f561fe25d00cc8d133db74197dba6bd83721ebb8547a994646ceb79" exitCode=0 May 27 21:06:42.859959 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.859818 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerDied","Data":"d71c9c090f561fe25d00cc8d133db74197dba6bd83721ebb8547a994646ceb79"} May 27 21:06:42.863214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.863197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:06:42.863523 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.863488 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"89fe9d2c6aecef6a354fb6c20484e9a73ee6d376369e096b9a7d89003c23b919"} May 27 21:06:42.863776 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.863756 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:42.863893 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.863877 2566 scope.go:117] "RemoveContainer" containerID="20e59f3bface4afc7424b01a9b413ab9f1f24cd86d045dc239873ef6a76d56e1" May 27 21:06:42.879581 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:42.879564 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:43.692995 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.692965 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:43.693379 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:43.693070 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:43.693379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.693125 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:43.693379 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:43.693214 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:43.867339 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.867251 2566 generic.go:358] "Generic (PLEG): container finished" podID="c90bff16-1226-4f69-acdc-f51c55cdca9a" containerID="6e790ad873e179af2d6f0b7f38c17728ca515f63808f4b7761f624a8b8404d70" exitCode=0 May 27 21:06:43.867481 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.867330 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerDied","Data":"6e790ad873e179af2d6f0b7f38c17728ca515f63808f4b7761f624a8b8404d70"} May 27 21:06:43.870995 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.870965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:06:43.871334 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.871301 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" event={"ID":"9c73bd75-c52d-48b5-81ea-30c402efbfe6","Type":"ContainerStarted","Data":"76493707679ebf68b82995ece35ed0bce8a8e02fec8d919fa8539c61fc32083c"} May 27 21:06:43.871497 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.871485 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 21:06:43.871655 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.871636 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:43.886272 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.886251 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:43.918869 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.918820 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" podStartSLOduration=10.127292205 podStartE2EDuration="28.91880469s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.218600991 +0000 UTC m=+3.069050025" lastFinishedPulling="2026-05-27 21:06:37.010113472 +0000 UTC m=+21.860562510" observedRunningTime="2026-05-27 21:06:43.918300897 +0000 UTC m=+28.768749953" watchObservedRunningTime="2026-05-27 21:06:43.91880469 +0000 UTC m=+28.769253748" May 27 21:06:43.995294 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:43.995276 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:06:44.171148 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.171077 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2ts5d"] May 27 21:06:44.171262 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.171192 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:44.171328 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:44.171311 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:44.174216 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.174190 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7whx7"] May 27 21:06:44.174336 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.174269 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:44.174394 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:44.174364 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:44.174832 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.174807 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-568ck"] May 27 21:06:44.174954 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.174901 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:44.175022 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:44.175000 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:44.875522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.875231 2566 generic.go:358] "Generic (PLEG): container finished" podID="c90bff16-1226-4f69-acdc-f51c55cdca9a" containerID="a90296d9784945f3939496789f774aecc7742005a812849d9a3ce1e8f1dcf806" exitCode=0 May 27 21:06:44.875871 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:44.875320 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerDied","Data":"a90296d9784945f3939496789f774aecc7742005a812849d9a3ce1e8f1dcf806"} May 27 21:06:45.693498 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:45.693465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:45.693668 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:45.693573 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:45.693730 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:45.693666 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:45.693815 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:45.693790 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:45.693886 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:45.693844 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:45.693973 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:45.693880 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:47.693031 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:47.692997 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:47.693525 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:47.692997 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:47.693525 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:47.693114 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:47.693525 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:47.693132 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:47.693525 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:47.693201 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:47.693525 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:47.693292 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:49.327470 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:49.327435 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:49.327954 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.327574 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:49.327954 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.327593 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:49.327954 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.327604 2566 projected.go:194] Error preparing data for projected volume kube-api-access-nhgzv for pod openshift-network-diagnostics/network-check-target-568ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:49.327954 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.327665 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv podName:e52fcb62-201d-4ac1-8964-5a4a89f07a2f nodeName:}" failed. No retries permitted until 2026-05-27 21:07:21.327647374 +0000 UTC m=+66.178096414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhgzv" (UniqueName: "kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv") pod "network-check-target-568ck" (UID: "e52fcb62-201d-4ac1-8964-5a4a89f07a2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:49.428033 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:49.428003 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:49.428186 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:49.428060 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:49.428186 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.428153 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:49.428186 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.428155 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:06:49.428333 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.428199 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:07:21.428186875 +0000 UTC m=+66.278635909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:49.428333 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.428211 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret podName:f858b472-d81f-4a62-978b-0df92a5dd499 nodeName:}" failed. No retries permitted until 2026-05-27 21:07:21.42820542 +0000 UTC m=+66.278654455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret") pod "global-pull-secret-syncer-7whx7" (UID: "f858b472-d81f-4a62-978b-0df92a5dd499") : object "kube-system"/"original-pull-secret" not registered May 27 21:06:49.692279 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:49.692204 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:49.692482 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:49.692325 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:49.692482 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.692403 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7whx7" podUID="f858b472-d81f-4a62-978b-0df92a5dd499" May 27 21:06:49.692482 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.692325 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:06:49.692482 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:49.692450 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:49.692687 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:49.692504 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-568ck" podUID="e52fcb62-201d-4ac1-8964-5a4a89f07a2f" May 27 21:06:50.440983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.440898 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-186.ec2.internal" event="NodeReady" May 27 21:06:50.441394 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.441059 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 21:06:50.501172 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.501140 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-njhk2"] May 27 21:06:50.530466 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.530432 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zw2qv"] May 27 21:06:50.530643 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.530553 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.533820 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.533793 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 21:06:50.533970 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.533828 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 21:06:50.533970 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.533794 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r8bdp\"" May 27 21:06:50.546574 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.546552 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njhk2"] May 27 21:06:50.546574 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.546577 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zw2qv"] May 27 21:06:50.546698 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.546668 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:50.549717 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.549700 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 21:06:50.550276 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.550257 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 21:06:50.550276 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.550261 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p6pfz\"" May 27 21:06:50.550687 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.550669 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 21:06:50.638295 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.638271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdddf309-c048-451c-a65b-2fc7065e56fa-config-volume\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.638438 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.638303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5pfn\" (UniqueName: \"kubernetes.io/projected/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-kube-api-access-q5pfn\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:50.638438 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.638326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.638438 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.638354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdddf309-c048-451c-a65b-2fc7065e56fa-tmp-dir\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.638438 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.638422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2h8\" (UniqueName: \"kubernetes.io/projected/cdddf309-c048-451c-a65b-2fc7065e56fa-kube-api-access-ml2h8\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.638626 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.638504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:50.739479 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.739395 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.739491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdddf309-c048-451c-a65b-2fc7065e56fa-config-volume\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.739519 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5pfn\" (UniqueName: \"kubernetes.io/projected/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-kube-api-access-q5pfn\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.739540 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.739562 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdddf309-c048-451c-a65b-2fc7065e56fa-tmp-dir\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:50.739564 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.739592 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2h8\" (UniqueName: \"kubernetes.io/projected/cdddf309-c048-451c-a65b-2fc7065e56fa-kube-api-access-ml2h8\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.739639 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:50.739638 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:06:51.23961677 +0000 UTC m=+36.090065820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:06:50.740030 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:50.739911 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:50.740030 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:50.739986 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:06:51.239970768 +0000 UTC m=+36.090419808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:06:50.740159 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.740088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdddf309-c048-451c-a65b-2fc7065e56fa-config-volume\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.740250 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.740222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdddf309-c048-451c-a65b-2fc7065e56fa-tmp-dir\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.751246 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.751219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2h8\" (UniqueName: \"kubernetes.io/projected/cdddf309-c048-451c-a65b-2fc7065e56fa-kube-api-access-ml2h8\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:50.751358 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:50.751273 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5pfn\" (UniqueName: \"kubernetes.io/projected/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-kube-api-access-q5pfn\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:51.242727 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.242707 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:51.242804 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.242748 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:51.242841 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:51.242834 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:51.242885 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:51.242840 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:51.242885 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:51.242877 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:06:52.242864447 +0000 UTC m=+37.093313482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:06:51.242987 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:51.242890 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:06:52.242883471 +0000 UTC m=+37.093332506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:06:51.693024 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.692997 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:06:51.693024 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.693013 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:06:51.693523 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.693025 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:06:51.695848 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.695830 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvnhn\"" May 27 21:06:51.696772 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.696749 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx2x6\"" May 27 21:06:51.696772 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.696759 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:06:51.696772 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.696768 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:06:51.697019 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.696823 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:06:51.697019 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.696846 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:06:51.889864 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.889807 2566 generic.go:358] "Generic (PLEG): container finished" podID="c90bff16-1226-4f69-acdc-f51c55cdca9a" containerID="6b852e6c9f2e6040b838018a170d734710f1f61f964d4e61cffe02f8cfddd1f5" exitCode=0 May 27 21:06:51.889990 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:51.889864 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerDied","Data":"6b852e6c9f2e6040b838018a170d734710f1f61f964d4e61cffe02f8cfddd1f5"} May 27 21:06:52.248692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:52.248617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:52.248692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:52.248670 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:52.248882 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:52.248761 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:52.248882 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:52.248790 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:52.248882 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:52.248827 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:06:54.248809052 +0000 UTC m=+39.099258087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:06:52.248882 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:52.248851 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:06:54.248833889 +0000 UTC m=+39.099282945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:06:52.894640 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:52.894605 2566 generic.go:358] "Generic (PLEG): container finished" podID="c90bff16-1226-4f69-acdc-f51c55cdca9a" containerID="3b21da0ad7b004e7261f9395ddeb6feec32c0c46317a740da9215f9906fa54fe" exitCode=0 May 27 21:06:52.895109 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:52.894667 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerDied","Data":"3b21da0ad7b004e7261f9395ddeb6feec32c0c46317a740da9215f9906fa54fe"} May 27 21:06:53.899371 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:53.899339 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" event={"ID":"c90bff16-1226-4f69-acdc-f51c55cdca9a","Type":"ContainerStarted","Data":"989e38c184de2cdc36d792d2f186c55adf14697a7616b6f99294708f1d6b007d"} May 27 21:06:53.923216 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:53.923174 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wl9kv" podStartSLOduration=5.934410131 podStartE2EDuration="38.923160881s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:06:18.22536333 +0000 UTC m=+3.075812379" lastFinishedPulling="2026-05-27 21:06:51.214114076 +0000 UTC m=+36.064563129" observedRunningTime="2026-05-27 21:06:53.921580679 +0000 UTC m=+38.772029748" watchObservedRunningTime="2026-05-27 21:06:53.923160881 +0000 UTC m=+38.773609937" May 27 21:06:54.265032 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:54.265000 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:54.265200 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:54.265046 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:54.265200 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:54.265131 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:54.265200 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:54.265187 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:06:58.265172389 +0000 UTC m=+43.115621423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:06:54.265328 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:54.265134 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:54.265328 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:54.265257 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:06:58.265246453 +0000 UTC m=+43.115695488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:06:58.289938 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:58.289893 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:06:58.290411 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:06:58.289964 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:06:58.290411 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:58.290055 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:58.290411 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:58.290065 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:58.290411 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:58.290105 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:07:06.290092837 +0000 UTC m=+51.140541872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:06:58.290411 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:06:58.290129 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:07:06.290112803 +0000 UTC m=+51.140561851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:07:06.342435 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:06.342398 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:07:06.342973 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:06.342449 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:07:06.342973 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:06.342556 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:07:06.342973 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:06.342560 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:07:06.342973 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:06.342624 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:07:22.342607983 +0000 UTC m=+67.193057017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:07:06.342973 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:06.342638 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:07:22.342631822 +0000 UTC m=+67.193080857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:07:15.887800 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:15.887764 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztbxp" May 27 21:07:21.347941 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.347869 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:07:21.351114 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.351091 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:07:21.361035 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.361013 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:07:21.372833 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.372803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhgzv\" (UniqueName: \"kubernetes.io/projected/e52fcb62-201d-4ac1-8964-5a4a89f07a2f-kube-api-access-nhgzv\") pod \"network-check-target-568ck\" (UID: \"e52fcb62-201d-4ac1-8964-5a4a89f07a2f\") " pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:07:21.415062 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.415031 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx2x6\"" May 27 21:07:21.423299 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.423274 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:07:21.448520 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.448487 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:07:21.448689 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.448541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:07:21.451428 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.451402 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:07:21.451534 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.451506 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:07:21.459723 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:21.459695 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 21:07:21.459850 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:21.459821 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:25.459796471 +0000 UTC m=+130.310245523 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : secret "metrics-daemon-secret" not found May 27 21:07:21.462254 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.462229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f858b472-d81f-4a62-978b-0df92a5dd499-original-pull-secret\") pod \"global-pull-secret-syncer-7whx7\" (UID: \"f858b472-d81f-4a62-978b-0df92a5dd499\") " pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:07:21.614791 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.614701 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-568ck"] May 27 21:07:21.618325 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:07:21.618282 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52fcb62_201d_4ac1_8964_5a4a89f07a2f.slice/crio-7a493f747d240243d0187da9d0f1a9b662c94de6e7311516beedf483c419d100 WatchSource:0}: Error finding container 7a493f747d240243d0187da9d0f1a9b662c94de6e7311516beedf483c419d100: Status 404 returned error can't find the container with id 7a493f747d240243d0187da9d0f1a9b662c94de6e7311516beedf483c419d100 May 27 21:07:21.703038 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.703010 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7whx7" May 27 21:07:21.843519 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.843487 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7whx7"] May 27 21:07:21.846998 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:07:21.846967 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf858b472_d81f_4a62_978b_0df92a5dd499.slice/crio-6829099ff56c1c6337f96a2d214cb85d0f8192d86637b2d2aa8d4530420edcfc WatchSource:0}: Error finding container 6829099ff56c1c6337f96a2d214cb85d0f8192d86637b2d2aa8d4530420edcfc: Status 404 returned error can't find the container with id 6829099ff56c1c6337f96a2d214cb85d0f8192d86637b2d2aa8d4530420edcfc May 27 21:07:21.947357 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.947263 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-568ck" event={"ID":"e52fcb62-201d-4ac1-8964-5a4a89f07a2f","Type":"ContainerStarted","Data":"7a493f747d240243d0187da9d0f1a9b662c94de6e7311516beedf483c419d100"} May 27 21:07:21.948271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:21.948247 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7whx7" event={"ID":"f858b472-d81f-4a62-978b-0df92a5dd499","Type":"ContainerStarted","Data":"6829099ff56c1c6337f96a2d214cb85d0f8192d86637b2d2aa8d4530420edcfc"} May 27 21:07:22.355504 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:22.355466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:07:22.356069 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:22.355523 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:07:22.356069 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:22.355620 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:07:22.356069 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:22.355624 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:07:22.356069 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:22.355689 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:07:54.355664495 +0000 UTC m=+99.206113547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:07:22.356069 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:22.355703 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:07:54.355697552 +0000 UTC m=+99.206146590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:07:25.958671 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:25.958624 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7whx7" event={"ID":"f858b472-d81f-4a62-978b-0df92a5dd499","Type":"ContainerStarted","Data":"256b1e10de71bf83062941a7e6ffcb4628e986e1ee3fcc60b3968931bbf67188"} May 27 21:07:25.960086 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:25.960063 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-568ck" event={"ID":"e52fcb62-201d-4ac1-8964-5a4a89f07a2f","Type":"ContainerStarted","Data":"35509ba21a543c791588136ca0ffac5f128dc635ab384e787e5992871761d51d"} May 27 21:07:25.960203 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:25.960190 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:07:25.984505 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:25.984441 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7whx7" podStartSLOduration=66.025739032 podStartE2EDuration="1m9.984421555s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:07:21.848552969 +0000 UTC m=+66.699002007" lastFinishedPulling="2026-05-27 21:07:25.807235492 +0000 UTC m=+70.657684530" observedRunningTime="2026-05-27 21:07:25.983994908 +0000 UTC m=+70.834443964" watchObservedRunningTime="2026-05-27 21:07:25.984421555 +0000 UTC m=+70.834870612" May 27 21:07:26.012850 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:26.012799 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-568ck" podStartSLOduration=66.828400711 podStartE2EDuration="1m11.012780975s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:07:21.620101014 +0000 UTC m=+66.470550053" lastFinishedPulling="2026-05-27 21:07:25.804481278 +0000 UTC m=+70.654930317" observedRunningTime="2026-05-27 21:07:26.0117057 +0000 UTC m=+70.862154758" watchObservedRunningTime="2026-05-27 21:07:26.012780975 +0000 UTC m=+70.863230032" May 27 21:07:54.378180 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:54.375616 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:07:54.378180 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:54.375789 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:07:54.378180 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:54.376009 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:07:54.378180 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:54.376055 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:07:54.378180 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:54.376110 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert podName:d4b66618-2f2b-442d-9cc1-0246ec8b7bda nodeName:}" failed. No retries permitted until 2026-05-27 21:08:58.376079059 +0000 UTC m=+163.226528111 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert") pod "ingress-canary-zw2qv" (UID: "d4b66618-2f2b-442d-9cc1-0246ec8b7bda") : secret "canary-serving-cert" not found May 27 21:07:54.378180 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:07:54.376139 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls podName:cdddf309-c048-451c-a65b-2fc7065e56fa nodeName:}" failed. No retries permitted until 2026-05-27 21:08:58.376118481 +0000 UTC m=+163.226567516 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls") pod "dns-default-njhk2" (UID: "cdddf309-c048-451c-a65b-2fc7065e56fa") : secret "dns-default-metrics-tls" not found May 27 21:07:56.965105 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:07:56.965071 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-568ck" May 27 21:08:16.885081 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.885044 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m"] May 27 21:08:16.886975 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.886955 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:16.890662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.890637 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 27 21:08:16.890795 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.890636 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 21:08:16.891658 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.891637 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h7nlk\"" May 27 21:08:16.891756 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.891645 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 21:08:16.891756 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.891691 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 27 21:08:16.899125 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.899091 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m"] May 27 21:08:16.991515 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.991478 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b587b8bd4-k9vw6"] May 27 21:08:16.993281 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.993264 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:16.995892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.995855 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 27 21:08:16.996177 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.996157 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 27 21:08:16.996177 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.996173 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 21:08:16.996326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.996182 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 27 21:08:16.996326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.996202 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rc2v8\"" May 27 21:08:16.996326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.996213 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 27 21:08:16.996476 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:16.996384 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 21:08:17.005874 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.005848 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b587b8bd4-k9vw6"] May 27 21:08:17.022213 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.022175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9fdh\" (UniqueName: \"kubernetes.io/projected/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-kube-api-access-k9fdh\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.022428 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.022300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.022428 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.022363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.123452 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123405 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9fdh\" (UniqueName: \"kubernetes.io/projected/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-kube-api-access-k9fdh\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.123452 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-stats-auth\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.123692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.123692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.123692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123636 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.123692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-default-certificate\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.123906 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fczf\" (UniqueName: \"kubernetes.io/projected/c378c8d3-c577-4110-a45a-3ddd5ae59503-kube-api-access-8fczf\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.123906 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.123825 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.123906 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.123900 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:08:17.124096 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.123990 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls podName:7ab8ea35-c6dd-4b9a-a0c1-8209add5b314 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:17.623974861 +0000 UTC m=+122.474423895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5kb5m" (UID: "7ab8ea35-c6dd-4b9a-a0c1-8209add5b314") : secret "cluster-monitoring-operator-tls" not found May 27 21:08:17.124451 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.124426 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.140799 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.140737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9fdh\" (UniqueName: \"kubernetes.io/projected/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-kube-api-access-k9fdh\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.224180 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.224148 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-stats-auth\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.224342 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.224192 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.224342 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.224228 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.224342 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.224325 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:08:17.224503 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.224353 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:17.724333713 +0000 UTC m=+122.574782768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : configmap references non-existent config key: service-ca.crt May 27 21:08:17.224503 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.224387 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-default-certificate\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.224503 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.224401 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:17.724381671 +0000 UTC m=+122.574830709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : secret "router-metrics-certs-default" not found May 27 21:08:17.224503 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.224445 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fczf\" (UniqueName: \"kubernetes.io/projected/c378c8d3-c577-4110-a45a-3ddd5ae59503-kube-api-access-8fczf\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.226612 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.226582 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-stats-auth\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.226714 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.226617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-default-certificate\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.233864 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.233846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fczf\" (UniqueName: \"kubernetes.io/projected/c378c8d3-c577-4110-a45a-3ddd5ae59503-kube-api-access-8fczf\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.628031 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.627984 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:17.628207 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.628137 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:08:17.628247 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.628212 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls podName:7ab8ea35-c6dd-4b9a-a0c1-8209add5b314 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:18.628195188 +0000 UTC m=+123.478644236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5kb5m" (UID: "7ab8ea35-c6dd-4b9a-a0c1-8209add5b314") : secret "cluster-monitoring-operator-tls" not found May 27 21:08:17.728598 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.728557 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.728805 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:17.728610 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:17.728805 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.728701 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:08:17.728805 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.728745 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:18.728723978 +0000 UTC m=+123.579173034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : configmap references non-existent config key: service-ca.crt May 27 21:08:17.728805 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:17.728766 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:18.728757083 +0000 UTC m=+123.579206117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : secret "router-metrics-certs-default" not found May 27 21:08:18.636940 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:18.636886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:18.637332 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:18.637038 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:08:18.637332 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:18.637103 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls podName:7ab8ea35-c6dd-4b9a-a0c1-8209add5b314 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:20.637085592 +0000 UTC m=+125.487534650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5kb5m" (UID: "7ab8ea35-c6dd-4b9a-a0c1-8209add5b314") : secret "cluster-monitoring-operator-tls" not found May 27 21:08:18.738078 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:18.738042 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:18.738078 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:18.738092 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:18.738250 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:18.738205 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:08:18.738289 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:18.738279 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:20.738262302 +0000 UTC m=+125.588711338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : secret "router-metrics-certs-default" not found May 27 21:08:18.738328 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:18.738294 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:20.738287729 +0000 UTC m=+125.588736764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : configmap references non-existent config key: service-ca.crt May 27 21:08:20.651395 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:20.651361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:20.651781 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:20.651472 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:08:20.651781 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:20.651538 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls podName:7ab8ea35-c6dd-4b9a-a0c1-8209add5b314 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:24.651523082 +0000 UTC m=+129.501972117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5kb5m" (UID: "7ab8ea35-c6dd-4b9a-a0c1-8209add5b314") : secret "cluster-monitoring-operator-tls" not found May 27 21:08:20.752623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:20.752586 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:20.752682 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:20.752635 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:20.752755 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:20.752737 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:08:20.752788 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:20.752768 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:24.75275347 +0000 UTC m=+129.603202508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : configmap references non-existent config key: service-ca.crt May 27 21:08:20.752831 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:20.752810 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:24.752786588 +0000 UTC m=+129.603235627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : secret "router-metrics-certs-default" not found May 27 21:08:22.787845 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:22.787818 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v7cwz_c0dbdf25-c120-422a-b5ed-e2787733801d/dns-node-resolver/0.log" May 27 21:08:23.588564 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:23.588532 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sw768_0dc2df21-ae9a-44cc-9ae1-c6495f563ff4/node-ca/0.log" May 27 21:08:24.681640 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:24.681606 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:24.682076 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:24.681765 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:08:24.682076 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:24.681841 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls podName:7ab8ea35-c6dd-4b9a-a0c1-8209add5b314 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:32.68182287 +0000 UTC m=+137.532271906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5kb5m" (UID: "7ab8ea35-c6dd-4b9a-a0c1-8209add5b314") : secret "cluster-monitoring-operator-tls" not found May 27 21:08:24.782194 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:24.782155 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:24.782270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:24.782206 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:24.782328 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:24.782309 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:08:24.782367 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:24.782317 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:32.782303137 +0000 UTC m=+137.632752171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : configmap references non-existent config key: service-ca.crt May 27 21:08:24.782405 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:24.782385 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:32.782370848 +0000 UTC m=+137.632819887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : secret "router-metrics-certs-default" not found May 27 21:08:25.486784 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:25.486740 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:08:25.486989 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:25.486867 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 21:08:25.486989 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:25.486948 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs podName:eb39e458-d2d6-4bb3-bf78-ef0e06839905 nodeName:}" failed. No retries permitted until 2026-05-27 21:10:27.486912153 +0000 UTC m=+252.337361192 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs") pod "network-metrics-daemon-2ts5d" (UID: "eb39e458-d2d6-4bb3-bf78-ef0e06839905") : secret "metrics-daemon-secret" not found May 27 21:08:27.108033 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.107993 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8"] May 27 21:08:27.110489 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.110472 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.112806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.112779 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 27 21:08:27.113017 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.112876 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cmtr7\"" May 27 21:08:27.114020 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.113998 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 27 21:08:27.114020 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.113998 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 27 21:08:27.118741 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.118721 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8"] May 27 21:08:27.202168 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.202135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.202168 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.202170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nlm6\" (UniqueName: \"kubernetes.io/projected/64a07de1-c3d7-424c-8d57-39158fca2739-kube-api-access-6nlm6\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.303528 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.303467 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.303528 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.303531 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nlm6\" (UniqueName: \"kubernetes.io/projected/64a07de1-c3d7-424c-8d57-39158fca2739-kube-api-access-6nlm6\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.303755 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:27.303630 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:08:27.303755 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:27.303699 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls podName:64a07de1-c3d7-424c-8d57-39158fca2739 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:27.803681457 +0000 UTC m=+132.654130511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls") pod "cluster-samples-operator-697587599-rh5x8" (UID: "64a07de1-c3d7-424c-8d57-39158fca2739") : secret "samples-operator-tls" not found May 27 21:08:27.314621 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.314595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nlm6\" (UniqueName: \"kubernetes.io/projected/64a07de1-c3d7-424c-8d57-39158fca2739-kube-api-access-6nlm6\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.808818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:27.808756 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:27.809042 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:27.808907 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:08:27.809042 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:27.809030 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls podName:64a07de1-c3d7-424c-8d57-39158fca2739 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:28.809012632 +0000 UTC m=+133.659461672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls") pod "cluster-samples-operator-697587599-rh5x8" (UID: "64a07de1-c3d7-424c-8d57-39158fca2739") : secret "samples-operator-tls" not found May 27 21:08:28.816347 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:28.816294 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:28.816812 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:28.816450 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:08:28.816812 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:28.816521 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls podName:64a07de1-c3d7-424c-8d57-39158fca2739 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:30.816502374 +0000 UTC m=+135.666951428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls") pod "cluster-samples-operator-697587599-rh5x8" (UID: "64a07de1-c3d7-424c-8d57-39158fca2739") : secret "samples-operator-tls" not found May 27 21:08:30.833628 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:30.833587 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:30.834063 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:30.833745 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:08:30.834063 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:30.833816 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls podName:64a07de1-c3d7-424c-8d57-39158fca2739 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:34.833801442 +0000 UTC m=+139.684250481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls") pod "cluster-samples-operator-697587599-rh5x8" (UID: "64a07de1-c3d7-424c-8d57-39158fca2739") : secret "samples-operator-tls" not found May 27 21:08:32.748146 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:32.748109 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:32.748537 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:32.748274 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:08:32.748537 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:32.748354 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls podName:7ab8ea35-c6dd-4b9a-a0c1-8209add5b314 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:48.748338019 +0000 UTC m=+153.598787057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5kb5m" (UID: "7ab8ea35-c6dd-4b9a-a0c1-8209add5b314") : secret "cluster-monitoring-operator-tls" not found May 27 21:08:32.849443 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:32.849394 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:32.849443 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:32.849447 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:32.849657 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:32.849547 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:48.849532601 +0000 UTC m=+153.699981651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : configmap references non-existent config key: service-ca.crt May 27 21:08:32.849657 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:32.849592 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:08:32.849657 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:32.849647 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs podName:c378c8d3-c577-4110-a45a-3ddd5ae59503 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:48.849636012 +0000 UTC m=+153.700085050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs") pod "router-default-5b587b8bd4-k9vw6" (UID: "c378c8d3-c577-4110-a45a-3ddd5ae59503") : secret "router-metrics-certs-default" not found May 27 21:08:34.035587 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.035552 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8wxbr"] May 27 21:08:34.037690 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.037664 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.041108 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.041079 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 21:08:34.041278 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.041261 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 21:08:34.042226 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.042206 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96bzc\"" May 27 21:08:34.042329 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.042237 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 21:08:34.042329 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.042252 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 21:08:34.048846 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.048826 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8wxbr"] May 27 21:08:34.160001 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.159953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4917669f-acfb-4394-bec3-fa0e9ecdff38-data-volume\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.160175 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.160019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4917669f-acfb-4394-bec3-fa0e9ecdff38-crio-socket\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.160175 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.160039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4917669f-acfb-4394-bec3-fa0e9ecdff38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.160175 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.160091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zt87\" (UniqueName: \"kubernetes.io/projected/4917669f-acfb-4394-bec3-fa0e9ecdff38-kube-api-access-2zt87\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.160330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.160200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.260709 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.260673 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.260899 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.260713 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4917669f-acfb-4394-bec3-fa0e9ecdff38-data-volume\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.260899 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.260743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4917669f-acfb-4394-bec3-fa0e9ecdff38-crio-socket\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.260899 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.260758 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4917669f-acfb-4394-bec3-fa0e9ecdff38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.260899 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:34.260838 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:34.261099 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.260901 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zt87\" (UniqueName: \"kubernetes.io/projected/4917669f-acfb-4394-bec3-fa0e9ecdff38-kube-api-access-2zt87\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.261099 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:34.260950 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls podName:4917669f-acfb-4394-bec3-fa0e9ecdff38 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:34.760907764 +0000 UTC m=+139.611356814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wxbr" (UID: "4917669f-acfb-4394-bec3-fa0e9ecdff38") : secret "insights-runtime-extractor-tls" not found May 27 21:08:34.261099 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.260842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4917669f-acfb-4394-bec3-fa0e9ecdff38-crio-socket\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.261210 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.261123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4917669f-acfb-4394-bec3-fa0e9ecdff38-data-volume\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.261361 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.261345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4917669f-acfb-4394-bec3-fa0e9ecdff38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.270442 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.270421 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zt87\" (UniqueName: \"kubernetes.io/projected/4917669f-acfb-4394-bec3-fa0e9ecdff38-kube-api-access-2zt87\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.467462 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.467369 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9r575"] May 27 21:08:34.469525 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.469504 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.475156 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.475133 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4b5rd\"" May 27 21:08:34.475156 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.475144 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 21:08:34.475425 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.475147 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 21:08:34.475545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.475529 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 21:08:34.475609 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.475549 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 21:08:34.483459 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.483437 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9r575"] May 27 21:08:34.663710 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.663672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/efb41502-adc1-454e-9ed3-4358273ced2c-signing-cabundle\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.663887 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.663725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2lvf\" (UniqueName: \"kubernetes.io/projected/efb41502-adc1-454e-9ed3-4358273ced2c-kube-api-access-x2lvf\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.663887 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.663784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/efb41502-adc1-454e-9ed3-4358273ced2c-signing-key\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.764688 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.764589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/efb41502-adc1-454e-9ed3-4358273ced2c-signing-cabundle\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.764688 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.764637 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:34.764688 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.764657 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lvf\" (UniqueName: \"kubernetes.io/projected/efb41502-adc1-454e-9ed3-4358273ced2c-kube-api-access-x2lvf\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.764984 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:34.764747 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:34.764984 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:34.764818 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls podName:4917669f-acfb-4394-bec3-fa0e9ecdff38 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:35.764797781 +0000 UTC m=+140.615246816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wxbr" (UID: "4917669f-acfb-4394-bec3-fa0e9ecdff38") : secret "insights-runtime-extractor-tls" not found May 27 21:08:34.764984 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.764855 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/efb41502-adc1-454e-9ed3-4358273ced2c-signing-key\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.765396 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.765373 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/efb41502-adc1-454e-9ed3-4358273ced2c-signing-cabundle\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.767227 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.767201 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/efb41502-adc1-454e-9ed3-4358273ced2c-signing-key\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.774172 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.774151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lvf\" (UniqueName: \"kubernetes.io/projected/efb41502-adc1-454e-9ed3-4358273ced2c-kube-api-access-x2lvf\") pod \"service-ca-67d667c7d-9r575\" (UID: \"efb41502-adc1-454e-9ed3-4358273ced2c\") " pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.778960 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.778943 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9r575" May 27 21:08:34.866269 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.866238 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:34.866430 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:34.866370 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:08:34.866479 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:34.866434 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls podName:64a07de1-c3d7-424c-8d57-39158fca2739 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:42.866418337 +0000 UTC m=+147.716867372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls") pod "cluster-samples-operator-697587599-rh5x8" (UID: "64a07de1-c3d7-424c-8d57-39158fca2739") : secret "samples-operator-tls" not found May 27 21:08:34.902223 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:34.902188 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9r575"] May 27 21:08:34.905399 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:34.905374 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb41502_adc1_454e_9ed3_4358273ced2c.slice/crio-a1cf4a00676d5b6c8d468983aabeef64eb7e030b4fc2da9464cf3b4b42dad036 WatchSource:0}: Error finding container a1cf4a00676d5b6c8d468983aabeef64eb7e030b4fc2da9464cf3b4b42dad036: Status 404 returned error can't find the container with id a1cf4a00676d5b6c8d468983aabeef64eb7e030b4fc2da9464cf3b4b42dad036 May 27 21:08:35.092859 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:35.092825 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9r575" event={"ID":"efb41502-adc1-454e-9ed3-4358273ced2c","Type":"ContainerStarted","Data":"a1cf4a00676d5b6c8d468983aabeef64eb7e030b4fc2da9464cf3b4b42dad036"} May 27 21:08:35.772655 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:35.772621 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:35.772847 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:35.772770 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:35.772905 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:35.772856 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls podName:4917669f-acfb-4394-bec3-fa0e9ecdff38 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:37.772833577 +0000 UTC m=+142.623282625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wxbr" (UID: "4917669f-acfb-4394-bec3-fa0e9ecdff38") : secret "insights-runtime-extractor-tls" not found May 27 21:08:37.097379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:37.097345 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9r575" event={"ID":"efb41502-adc1-454e-9ed3-4358273ced2c","Type":"ContainerStarted","Data":"2c8c1cba75744ff7615e5d099dce23c1b4b6ce89b4cf8e889c51c2b3ef7cc43e"} May 27 21:08:37.123493 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:37.123432 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-9r575" podStartSLOduration=1.423746604 podStartE2EDuration="3.123381822s" podCreationTimestamp="2026-05-27 21:08:34 +0000 UTC" firstStartedPulling="2026-05-27 21:08:34.907096547 +0000 UTC m=+139.757545585" lastFinishedPulling="2026-05-27 21:08:36.606731757 +0000 UTC m=+141.457180803" observedRunningTime="2026-05-27 21:08:37.122477176 +0000 UTC m=+141.972926236" watchObservedRunningTime="2026-05-27 21:08:37.123381822 +0000 UTC m=+141.973830880" May 27 21:08:37.790658 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:37.790620 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:37.790862 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:37.790833 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:37.790953 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:37.790941 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls podName:4917669f-acfb-4394-bec3-fa0e9ecdff38 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:41.790902479 +0000 UTC m=+146.641351518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wxbr" (UID: "4917669f-acfb-4394-bec3-fa0e9ecdff38") : secret "insights-runtime-extractor-tls" not found May 27 21:08:41.826860 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:41.826817 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:41.827391 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:41.827011 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:41.827391 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:41.827118 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls podName:4917669f-acfb-4394-bec3-fa0e9ecdff38 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:49.827095855 +0000 UTC m=+154.677544903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wxbr" (UID: "4917669f-acfb-4394-bec3-fa0e9ecdff38") : secret "insights-runtime-extractor-tls" not found May 27 21:08:42.936193 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:42.936141 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:42.938574 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:42.938546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a07de1-c3d7-424c-8d57-39158fca2739-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rh5x8\" (UID: \"64a07de1-c3d7-424c-8d57-39158fca2739\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:43.019402 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:43.019362 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" May 27 21:08:43.145617 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:43.145590 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8"] May 27 21:08:44.113102 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:44.113059 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" event={"ID":"64a07de1-c3d7-424c-8d57-39158fca2739","Type":"ContainerStarted","Data":"71c56d3da332e92fcc7120b1520defdfaa12c34e1951efada611bb2ffd81fff6"} May 27 21:08:46.119684 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:46.119648 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" event={"ID":"64a07de1-c3d7-424c-8d57-39158fca2739","Type":"ContainerStarted","Data":"92084d18a52fbdbaf598cfca65af5b992b75ae42180a6e1667411ec1850b0ddf"} May 27 21:08:46.119684 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:46.119689 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" event={"ID":"64a07de1-c3d7-424c-8d57-39158fca2739","Type":"ContainerStarted","Data":"b7cb201299abb1bbaed29a46022dbc08403ae6674b48d15a62fa63270c9f23ba"} May 27 21:08:46.137055 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:46.137008 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rh5x8" podStartSLOduration=16.917056993 podStartE2EDuration="19.13699328s" podCreationTimestamp="2026-05-27 21:08:27 +0000 UTC" firstStartedPulling="2026-05-27 21:08:43.183204062 +0000 UTC m=+148.033653098" lastFinishedPulling="2026-05-27 21:08:45.403140346 +0000 UTC m=+150.253589385" observedRunningTime="2026-05-27 21:08:46.136149872 +0000 UTC m=+150.986598931" watchObservedRunningTime="2026-05-27 21:08:46.13699328 +0000 UTC m=+150.987442337" May 27 21:08:48.794315 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.794275 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:48.796629 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.796607 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ab8ea35-c6dd-4b9a-a0c1-8209add5b314-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5kb5m\" (UID: \"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:48.894855 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.894814 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:48.895051 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.894964 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:48.895471 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.895447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c378c8d3-c577-4110-a45a-3ddd5ae59503-service-ca-bundle\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:48.897284 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.897261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c378c8d3-c577-4110-a45a-3ddd5ae59503-metrics-certs\") pod \"router-default-5b587b8bd4-k9vw6\" (UID: \"c378c8d3-c577-4110-a45a-3ddd5ae59503\") " pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:48.995636 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:48.995600 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" May 27 21:08:49.102769 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:49.102733 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:49.126728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:49.126649 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m"] May 27 21:08:49.131487 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:49.131461 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab8ea35_c6dd_4b9a_a0c1_8209add5b314.slice/crio-f0466b7fb713cc588a5dba1908c9bf847353337120658705f8349c40e143854b WatchSource:0}: Error finding container f0466b7fb713cc588a5dba1908c9bf847353337120658705f8349c40e143854b: Status 404 returned error can't find the container with id f0466b7fb713cc588a5dba1908c9bf847353337120658705f8349c40e143854b May 27 21:08:49.231326 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:49.231293 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b587b8bd4-k9vw6"] May 27 21:08:49.234313 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:49.234281 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc378c8d3_c577_4110_a45a_3ddd5ae59503.slice/crio-bdb9e136217810fee7f87f7cda0721a3045530f2a81457503eb86e8fa852160f WatchSource:0}: Error finding container bdb9e136217810fee7f87f7cda0721a3045530f2a81457503eb86e8fa852160f: Status 404 returned error can't find the container with id bdb9e136217810fee7f87f7cda0721a3045530f2a81457503eb86e8fa852160f May 27 21:08:49.902071 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:49.902031 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:49.904729 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:49.904700 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4917669f-acfb-4394-bec3-fa0e9ecdff38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wxbr\" (UID: \"4917669f-acfb-4394-bec3-fa0e9ecdff38\") " pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:49.947516 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:49.947479 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8wxbr" May 27 21:08:50.091585 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:50.091554 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8wxbr"] May 27 21:08:50.094887 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:50.094848 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4917669f_acfb_4394_bec3_fa0e9ecdff38.slice/crio-bb73790d0e2b9394cc7ef91e7bce3811174efe05e67641d49d889819098a01cd WatchSource:0}: Error finding container bb73790d0e2b9394cc7ef91e7bce3811174efe05e67641d49d889819098a01cd: Status 404 returned error can't find the container with id bb73790d0e2b9394cc7ef91e7bce3811174efe05e67641d49d889819098a01cd May 27 21:08:50.130755 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:50.130718 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wxbr" event={"ID":"4917669f-acfb-4394-bec3-fa0e9ecdff38","Type":"ContainerStarted","Data":"bb73790d0e2b9394cc7ef91e7bce3811174efe05e67641d49d889819098a01cd"} May 27 21:08:50.132294 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:50.132267 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" event={"ID":"c378c8d3-c577-4110-a45a-3ddd5ae59503","Type":"ContainerStarted","Data":"f482639a2dcd8948c79312f09476767596c9d886a8ee759cba6b7d9883d21449"} May 27 21:08:50.132390 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:50.132300 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" event={"ID":"c378c8d3-c577-4110-a45a-3ddd5ae59503","Type":"ContainerStarted","Data":"bdb9e136217810fee7f87f7cda0721a3045530f2a81457503eb86e8fa852160f"} May 27 21:08:50.133410 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:50.133385 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" event={"ID":"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314","Type":"ContainerStarted","Data":"f0466b7fb713cc588a5dba1908c9bf847353337120658705f8349c40e143854b"} May 27 21:08:50.154096 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:50.154046 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" podStartSLOduration=34.154026361 podStartE2EDuration="34.154026361s" podCreationTimestamp="2026-05-27 21:08:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:08:50.153199256 +0000 UTC m=+155.003648338" watchObservedRunningTime="2026-05-27 21:08:50.154026361 +0000 UTC m=+155.004475418" May 27 21:08:51.103697 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:51.103660 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:51.106586 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:51.106561 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:51.137574 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:51.137535 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wxbr" event={"ID":"4917669f-acfb-4394-bec3-fa0e9ecdff38","Type":"ContainerStarted","Data":"e70ca73b68a6ff352179ca49fc933f5e5746ab0288bc96f5800e695e58d0745a"} May 27 21:08:51.137763 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:51.137743 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:51.139042 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:51.139020 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b587b8bd4-k9vw6" May 27 21:08:52.142209 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:52.142171 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" event={"ID":"7ab8ea35-c6dd-4b9a-a0c1-8209add5b314","Type":"ContainerStarted","Data":"a7cf1936ec49bfe03eb78b900d3aad9ce3384293a3239c00b6b3c8d72a523c69"} May 27 21:08:52.143890 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:52.143856 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wxbr" event={"ID":"4917669f-acfb-4394-bec3-fa0e9ecdff38","Type":"ContainerStarted","Data":"db4e6934f18aa1b2b2312f0c4ace01733ddf2becefe8479966da9f6a928268a8"} May 27 21:08:52.169174 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:52.169117 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5kb5m" podStartSLOduration=34.095045895 podStartE2EDuration="36.169102839s" podCreationTimestamp="2026-05-27 21:08:16 +0000 UTC" firstStartedPulling="2026-05-27 21:08:49.133423129 +0000 UTC m=+153.983872165" lastFinishedPulling="2026-05-27 21:08:51.207480071 +0000 UTC m=+156.057929109" observedRunningTime="2026-05-27 21:08:52.168810327 +0000 UTC m=+157.019259386" watchObservedRunningTime="2026-05-27 21:08:52.169102839 +0000 UTC m=+157.019551896" May 27 21:08:53.148076 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:53.148038 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wxbr" event={"ID":"4917669f-acfb-4394-bec3-fa0e9ecdff38","Type":"ContainerStarted","Data":"22ca37b44cea969dceb0a56492d89b3b9d012f7a707996b1bd4c60da5abe856d"} May 27 21:08:53.172032 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:53.171968 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8wxbr" podStartSLOduration=16.857766779 podStartE2EDuration="19.171946141s" podCreationTimestamp="2026-05-27 21:08:34 +0000 UTC" firstStartedPulling="2026-05-27 21:08:50.153461962 +0000 UTC m=+155.003911003" lastFinishedPulling="2026-05-27 21:08:52.467641314 +0000 UTC m=+157.318090365" observedRunningTime="2026-05-27 21:08:53.171019609 +0000 UTC m=+158.021468666" watchObservedRunningTime="2026-05-27 21:08:53.171946141 +0000 UTC m=+158.022395200" May 27 21:08:53.544087 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:53.544047 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-njhk2" podUID="cdddf309-c048-451c-a65b-2fc7065e56fa" May 27 21:08:53.555313 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:53.555284 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-zw2qv" podUID="d4b66618-2f2b-442d-9cc1-0246ec8b7bda" May 27 21:08:54.150718 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:54.150691 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njhk2" May 27 21:08:54.708518 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:08:54.708458 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2ts5d" podUID="eb39e458-d2d6-4bb3-bf78-ef0e06839905" May 27 21:08:55.375783 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.375747 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c564c7797-gg7d4"] May 27 21:08:55.377833 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.377815 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.380406 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.380381 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgcft\"" May 27 21:08:55.380578 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.380556 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 21:08:55.380691 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.380588 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 21:08:55.381306 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.381288 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 21:08:55.389886 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.389864 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 21:08:55.400874 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.400845 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6"] May 27 21:08:55.403093 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.403068 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c564c7797-gg7d4"] May 27 21:08:55.403206 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.403169 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:55.406863 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.406840 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 27 21:08:55.407644 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.407624 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w9mkt\"" May 27 21:08:55.420570 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.420537 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6"] May 27 21:08:55.444978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.444946 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-bound-sa-token\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445119 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.444989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91a159b4-d132-4626-97e8-3b96f3839ab6-ca-trust-extracted\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445119 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.445064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91a159b4-d132-4626-97e8-3b96f3839ab6-installation-pull-secrets\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445119 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.445098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91a159b4-d132-4626-97e8-3b96f3839ab6-registry-certificates\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.445129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91a159b4-d132-4626-97e8-3b96f3839ab6-image-registry-private-configuration\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.445157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsfl\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-kube-api-access-mxsfl\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445297 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.445233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-registry-tls\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.445297 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.445286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91a159b4-d132-4626-97e8-3b96f3839ab6-trusted-ca\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.545837 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.545806 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91a159b4-d132-4626-97e8-3b96f3839ab6-image-registry-private-configuration\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546011 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.545844 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsfl\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-kube-api-access-mxsfl\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546011 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.545880 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-registry-tls\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546011 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.545954 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91a159b4-d132-4626-97e8-3b96f3839ab6-trusted-ca\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546011 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.545981 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-bound-sa-token\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.546020 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91a159b4-d132-4626-97e8-3b96f3839ab6-ca-trust-extracted\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.546070 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91a159b4-d132-4626-97e8-3b96f3839ab6-installation-pull-secrets\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.546099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8795a564-2373-462b-91d3-33a314e0629c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6\" (UID: \"8795a564-2373-462b-91d3-33a314e0629c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:55.546235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.546137 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91a159b4-d132-4626-97e8-3b96f3839ab6-registry-certificates\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.546633 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.546604 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91a159b4-d132-4626-97e8-3b96f3839ab6-ca-trust-extracted\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.547058 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.547038 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91a159b4-d132-4626-97e8-3b96f3839ab6-trusted-ca\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.547129 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.547068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91a159b4-d132-4626-97e8-3b96f3839ab6-registry-certificates\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.548328 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.548303 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91a159b4-d132-4626-97e8-3b96f3839ab6-image-registry-private-configuration\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.549018 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.549002 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-registry-tls\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.549199 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.549179 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91a159b4-d132-4626-97e8-3b96f3839ab6-installation-pull-secrets\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.561739 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.561707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsfl\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-kube-api-access-mxsfl\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.563141 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.563109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91a159b4-d132-4626-97e8-3b96f3839ab6-bound-sa-token\") pod \"image-registry-7c564c7797-gg7d4\" (UID: \"91a159b4-d132-4626-97e8-3b96f3839ab6\") " pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.646501 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.646467 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8795a564-2373-462b-91d3-33a314e0629c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6\" (UID: \"8795a564-2373-462b-91d3-33a314e0629c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:55.649255 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.649227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8795a564-2373-462b-91d3-33a314e0629c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6\" (UID: \"8795a564-2373-462b-91d3-33a314e0629c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:55.687517 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.687477 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:55.712417 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.712384 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:55.843536 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.843459 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c564c7797-gg7d4"] May 27 21:08:55.846555 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:55.846531 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a159b4_d132_4626_97e8_3b96f3839ab6.slice/crio-f87b70dfe7238b66db050110b0295fe63d9a420d1f40c701755b98b2a957b936 WatchSource:0}: Error finding container f87b70dfe7238b66db050110b0295fe63d9a420d1f40c701755b98b2a957b936: Status 404 returned error can't find the container with id f87b70dfe7238b66db050110b0295fe63d9a420d1f40c701755b98b2a957b936 May 27 21:08:55.851274 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:55.851247 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6"] May 27 21:08:55.858772 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:55.858749 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8795a564_2373_462b_91d3_33a314e0629c.slice/crio-5cd874a39627beb7504ce94b765e0dd5662df9f014176a9068a30c80f24044e9 WatchSource:0}: Error finding container 5cd874a39627beb7504ce94b765e0dd5662df9f014176a9068a30c80f24044e9: Status 404 returned error can't find the container with id 5cd874a39627beb7504ce94b765e0dd5662df9f014176a9068a30c80f24044e9 May 27 21:08:56.156647 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:56.156560 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" event={"ID":"8795a564-2373-462b-91d3-33a314e0629c","Type":"ContainerStarted","Data":"5cd874a39627beb7504ce94b765e0dd5662df9f014176a9068a30c80f24044e9"} May 27 21:08:56.157874 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:56.157847 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" event={"ID":"91a159b4-d132-4626-97e8-3b96f3839ab6","Type":"ContainerStarted","Data":"371e735ec5f36614780907abf44583f9433677cef9979ee0150686c78ea516ae"} May 27 21:08:56.157874 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:56.157878 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" event={"ID":"91a159b4-d132-4626-97e8-3b96f3839ab6","Type":"ContainerStarted","Data":"f87b70dfe7238b66db050110b0295fe63d9a420d1f40c701755b98b2a957b936"} May 27 21:08:56.158092 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:56.157964 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:08:56.182533 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:56.182479 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" podStartSLOduration=1.182463648 podStartE2EDuration="1.182463648s" podCreationTimestamp="2026-05-27 21:08:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:08:56.181260987 +0000 UTC m=+161.031710041" watchObservedRunningTime="2026-05-27 21:08:56.182463648 +0000 UTC m=+161.032912704" May 27 21:08:57.161987 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:57.161951 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" event={"ID":"8795a564-2373-462b-91d3-33a314e0629c","Type":"ContainerStarted","Data":"dc76ca081a40bc48bc1e98152955f7a04d05f08818d5b5f6a9fbcff77a79caf0"} May 27 21:08:57.162394 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:57.162207 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:57.167765 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:57.167708 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" May 27 21:08:57.183386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:57.183342 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6" podStartSLOduration=1.085734769 podStartE2EDuration="2.183329454s" podCreationTimestamp="2026-05-27 21:08:55 +0000 UTC" firstStartedPulling="2026-05-27 21:08:55.860559353 +0000 UTC m=+160.711008388" lastFinishedPulling="2026-05-27 21:08:56.958154033 +0000 UTC m=+161.808603073" observedRunningTime="2026-05-27 21:08:57.182312957 +0000 UTC m=+162.032762015" watchObservedRunningTime="2026-05-27 21:08:57.183329454 +0000 UTC m=+162.033778511" May 27 21:08:58.468815 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.468774 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:08:58.469200 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.468829 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:08:58.471143 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.471119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdddf309-c048-451c-a65b-2fc7065e56fa-metrics-tls\") pod \"dns-default-njhk2\" (UID: \"cdddf309-c048-451c-a65b-2fc7065e56fa\") " pod="openshift-dns/dns-default-njhk2" May 27 21:08:58.471294 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.471274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4b66618-2f2b-442d-9cc1-0246ec8b7bda-cert\") pod \"ingress-canary-zw2qv\" (UID: \"d4b66618-2f2b-442d-9cc1-0246ec8b7bda\") " pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:08:58.654858 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.654828 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r8bdp\"" May 27 21:08:58.662116 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.662094 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njhk2" May 27 21:08:58.785385 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:58.785351 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njhk2"] May 27 21:08:58.788184 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:08:58.788152 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdddf309_c048_451c_a65b_2fc7065e56fa.slice/crio-1636baddb94096cdc1868eec6c1063408dbb09b01111148f45b480b919612dd0 WatchSource:0}: Error finding container 1636baddb94096cdc1868eec6c1063408dbb09b01111148f45b480b919612dd0: Status 404 returned error can't find the container with id 1636baddb94096cdc1868eec6c1063408dbb09b01111148f45b480b919612dd0 May 27 21:08:59.169122 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:08:59.169080 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njhk2" event={"ID":"cdddf309-c048-451c-a65b-2fc7065e56fa","Type":"ContainerStarted","Data":"1636baddb94096cdc1868eec6c1063408dbb09b01111148f45b480b919612dd0"} May 27 21:09:00.173631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:00.173593 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njhk2" event={"ID":"cdddf309-c048-451c-a65b-2fc7065e56fa","Type":"ContainerStarted","Data":"af457a6381be7e0cf32898f6d4050a3162820b593e4679404800d56b0ae100a0"} May 27 21:09:00.173631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:00.173632 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njhk2" event={"ID":"cdddf309-c048-451c-a65b-2fc7065e56fa","Type":"ContainerStarted","Data":"b16bfa999e1cefdd9772e2bc62fa20fdae1ee30d31d7f0fc0835638724a67ee1"} May 27 21:09:00.174086 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:00.173667 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-njhk2" May 27 21:09:00.191814 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:00.191724 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-njhk2" podStartSLOduration=129.041759134 podStartE2EDuration="2m10.191710004s" podCreationTimestamp="2026-05-27 21:06:50 +0000 UTC" firstStartedPulling="2026-05-27 21:08:58.790038709 +0000 UTC m=+163.640487745" lastFinishedPulling="2026-05-27 21:08:59.939989565 +0000 UTC m=+164.790438615" observedRunningTime="2026-05-27 21:09:00.191438637 +0000 UTC m=+165.041887694" watchObservedRunningTime="2026-05-27 21:09:00.191710004 +0000 UTC m=+165.042159055" May 27 21:09:03.228512 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.228475 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv"] May 27 21:09:03.231625 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.231606 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.259580 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.259550 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 27 21:09:03.259754 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.259695 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-27gkv\"" May 27 21:09:03.264199 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.264178 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 27 21:09:03.264357 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.264220 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 21:09:03.264416 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.264402 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 27 21:09:03.283286 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.283254 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ht6bt"] May 27 21:09:03.285720 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.285702 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.289207 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.289185 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 21:09:03.289327 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.289299 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 21:09:03.289410 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.289314 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krpk2\"" May 27 21:09:03.289651 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.289632 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 21:09:03.295149 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.295130 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv"] May 27 21:09:03.311507 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.311481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4fdh\" (UniqueName: \"kubernetes.io/projected/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-api-access-z4fdh\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.311662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.311522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.311662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.311549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.311662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.311574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.311662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.311612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.311662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.311633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.412933 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.412881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.412946 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.412970 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.412994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413140 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-root\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413387 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413142 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413387 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413224 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413387 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mt6q\" (UniqueName: \"kubernetes.io/projected/6f10bebb-94a1-44fb-a2d8-737b536e18ef-kube-api-access-5mt6q\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413387 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413304 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f10bebb-94a1-44fb-a2d8-737b536e18ef-metrics-client-ca\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413387 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-sys\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413387 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413380 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-textfile\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-wtmp\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413453 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-tls\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.413662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413479 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4fdh\" (UniqueName: \"kubernetes.io/projected/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-api-access-z4fdh\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413591 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.413908 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.413871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.414114 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.414094 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.415676 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.415654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.416138 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.416117 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.422551 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.422521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4fdh\" (UniqueName: \"kubernetes.io/projected/dd13556b-e72f-4036-8ed9-f54e00d9a7c8-kube-api-access-z4fdh\") pod \"kube-state-metrics-54fd6bc5c4-gn9gv\" (UID: \"dd13556b-e72f-4036-8ed9-f54e00d9a7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.514588 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514498 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.514588 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514538 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.514803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-root\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.514803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514632 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mt6q\" (UniqueName: \"kubernetes.io/projected/6f10bebb-94a1-44fb-a2d8-737b536e18ef-kube-api-access-5mt6q\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.514803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514668 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f10bebb-94a1-44fb-a2d8-737b536e18ef-metrics-client-ca\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.514803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-root\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.514803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-sys\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-sys\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514823 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-textfile\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514883 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-wtmp\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.514959 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-tls\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.515076 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-wtmp\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515360 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.515185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-textfile\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515360 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.515198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.515360 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.515298 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f10bebb-94a1-44fb-a2d8-737b536e18ef-metrics-client-ca\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.517225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.517206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-tls\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.517321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.517243 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f10bebb-94a1-44fb-a2d8-737b536e18ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.524317 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.524296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mt6q\" (UniqueName: \"kubernetes.io/projected/6f10bebb-94a1-44fb-a2d8-737b536e18ef-kube-api-access-5mt6q\") pod \"node-exporter-ht6bt\" (UID: \"6f10bebb-94a1-44fb-a2d8-737b536e18ef\") " pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.540310 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.540275 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" May 27 21:09:03.595609 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.595504 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ht6bt" May 27 21:09:03.606591 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:09:03.606547 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f10bebb_94a1_44fb_a2d8_737b536e18ef.slice/crio-0684f4a7d3db7f5e0ba3b566d71d9854eab9c631f329e07708c28d9dff861e35 WatchSource:0}: Error finding container 0684f4a7d3db7f5e0ba3b566d71d9854eab9c631f329e07708c28d9dff861e35: Status 404 returned error can't find the container with id 0684f4a7d3db7f5e0ba3b566d71d9854eab9c631f329e07708c28d9dff861e35 May 27 21:09:03.674947 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:03.674891 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv"] May 27 21:09:04.188003 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.187960 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht6bt" event={"ID":"6f10bebb-94a1-44fb-a2d8-737b536e18ef","Type":"ContainerStarted","Data":"0684f4a7d3db7f5e0ba3b566d71d9854eab9c631f329e07708c28d9dff861e35"} May 27 21:09:04.188972 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.188945 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" event={"ID":"dd13556b-e72f-4036-8ed9-f54e00d9a7c8","Type":"ContainerStarted","Data":"a5cf4ef243929bad6945aa20d1b36f9ca9ff91229b1a6eac1acf4eff62656fd1"} May 27 21:09:04.244330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.244272 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:09:04.247655 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.247631 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.250107 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.250076 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 21:09:04.250247 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.250119 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 21:09:04.250247 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.250124 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 21:09:04.250367 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.250327 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 21:09:04.251010 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.250989 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 21:09:04.251110 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.251054 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nnc2t\"" May 27 21:09:04.251110 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.251092 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 21:09:04.251226 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.251192 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 21:09:04.251283 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.251247 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 21:09:04.251473 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.251450 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 21:09:04.264978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.264947 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:09:04.320692 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.320883 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-volume\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.320883 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.320883 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fk54\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-kube-api-access-8fk54\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.320883 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-out\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-web-config\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.320970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.321014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.321133 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.321169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321225 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.321201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.321578 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.321232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422138 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422094 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422152 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422219 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422265 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422300 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-volume\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422347 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422371 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fk54\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-kube-api-access-8fk54\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422398 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-out\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422422 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422448 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-web-config\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422473 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.422827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422519 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.423086 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.422966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.424313 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.424283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.429778 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.427084 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.429778 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.429386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.429778 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.429690 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.430245 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.430189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.430667 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.430554 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.434827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.434793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-out\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.435211 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.435159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fk54\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-kube-api-access-8fk54\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.435330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.435248 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-web-config\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.435330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.435266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.435648 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.435605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.436170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.436132 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-volume\") pod \"alertmanager-main-0\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.560743 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.560667 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:09:04.693268 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.693232 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:09:04.696224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.696191 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p6pfz\"" May 27 21:09:04.704603 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:04.704579 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zw2qv" May 27 21:09:05.178245 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:05.178194 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zw2qv"] May 27 21:09:05.182050 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:09:05.182011 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b66618_2f2b_442d_9cc1_0246ec8b7bda.slice/crio-d93f0e5eebbc7aa8a71e155a1f3f4294a1d8b2e95f927f6a5333d8cba64874b3 WatchSource:0}: Error finding container d93f0e5eebbc7aa8a71e155a1f3f4294a1d8b2e95f927f6a5333d8cba64874b3: Status 404 returned error can't find the container with id d93f0e5eebbc7aa8a71e155a1f3f4294a1d8b2e95f927f6a5333d8cba64874b3 May 27 21:09:05.198157 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:05.198106 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht6bt" event={"ID":"6f10bebb-94a1-44fb-a2d8-737b536e18ef","Type":"ContainerStarted","Data":"8e3a1f01477c88c561f175968ca6792f115c23f0865a2cfbf4c30f46ddb919c6"} May 27 21:09:05.204328 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:05.204260 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" event={"ID":"dd13556b-e72f-4036-8ed9-f54e00d9a7c8","Type":"ContainerStarted","Data":"a9f303a27b2d826a08a1735437b43761c5281ca00188b1b05af2f0a830b2ff4b"} May 27 21:09:05.206784 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:05.206761 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:09:05.211998 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:05.211025 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zw2qv" event={"ID":"d4b66618-2f2b-442d-9cc1-0246ec8b7bda","Type":"ContainerStarted","Data":"d93f0e5eebbc7aa8a71e155a1f3f4294a1d8b2e95f927f6a5333d8cba64874b3"} May 27 21:09:05.698698 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:05.698671 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:09:06.216415 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:06.216370 2566 generic.go:358] "Generic (PLEG): container finished" podID="6f10bebb-94a1-44fb-a2d8-737b536e18ef" containerID="8e3a1f01477c88c561f175968ca6792f115c23f0865a2cfbf4c30f46ddb919c6" exitCode=0 May 27 21:09:06.216821 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:06.216790 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht6bt" event={"ID":"6f10bebb-94a1-44fb-a2d8-737b536e18ef","Type":"ContainerDied","Data":"8e3a1f01477c88c561f175968ca6792f115c23f0865a2cfbf4c30f46ddb919c6"} May 27 21:09:06.218476 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:06.218446 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"461a0b4bb1bec75ea3ac4135d8c257caa170692487f6e4d53010233a7c6937c5"} May 27 21:09:06.221286 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:06.221251 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" event={"ID":"dd13556b-e72f-4036-8ed9-f54e00d9a7c8","Type":"ContainerStarted","Data":"108163050a74620dcf4d2cddff4c0fb5d60a5639937c86364d3bc37596bd772b"} May 27 21:09:06.221399 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:06.221292 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" event={"ID":"dd13556b-e72f-4036-8ed9-f54e00d9a7c8","Type":"ContainerStarted","Data":"82a0dba3836c28588ec12ccc5976123c70e0ca3e06977233123aad670ecd3fb0"} May 27 21:09:06.258772 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:06.258711 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gn9gv" podStartSLOduration=1.911884518 podStartE2EDuration="3.258694359s" podCreationTimestamp="2026-05-27 21:09:03 +0000 UTC" firstStartedPulling="2026-05-27 21:09:03.680681903 +0000 UTC m=+168.531130939" lastFinishedPulling="2026-05-27 21:09:05.027491744 +0000 UTC m=+169.877940780" observedRunningTime="2026-05-27 21:09:06.256913046 +0000 UTC m=+171.107362103" watchObservedRunningTime="2026-05-27 21:09:06.258694359 +0000 UTC m=+171.109143415" May 27 21:09:07.229500 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.229411 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zw2qv" event={"ID":"d4b66618-2f2b-442d-9cc1-0246ec8b7bda","Type":"ContainerStarted","Data":"ad4101b50de90c27d90211857af8007fb6e87a8f51e202a1bba33ec3e4f51fa2"} May 27 21:09:07.231316 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.231289 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht6bt" event={"ID":"6f10bebb-94a1-44fb-a2d8-737b536e18ef","Type":"ContainerStarted","Data":"eb65bd7056a5bebba0e449c36d0cbe789dca4e5cc8a74e7b9cbff646ee3b71f6"} May 27 21:09:07.231440 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.231320 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht6bt" event={"ID":"6f10bebb-94a1-44fb-a2d8-737b536e18ef","Type":"ContainerStarted","Data":"cdd6d2bebf976f55453d2fbeda901c11832faa90a70e31df4936228718519a15"} May 27 21:09:07.232769 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.232743 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287" exitCode=0 May 27 21:09:07.232889 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.232822 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287"} May 27 21:09:07.275145 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.275091 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zw2qv" podStartSLOduration=135.473495065 podStartE2EDuration="2m17.275076046s" podCreationTimestamp="2026-05-27 21:06:50 +0000 UTC" firstStartedPulling="2026-05-27 21:09:05.184759071 +0000 UTC m=+170.035208124" lastFinishedPulling="2026-05-27 21:09:06.986340066 +0000 UTC m=+171.836789105" observedRunningTime="2026-05-27 21:09:07.244740948 +0000 UTC m=+172.095190009" watchObservedRunningTime="2026-05-27 21:09:07.275076046 +0000 UTC m=+172.125525115" May 27 21:09:07.293329 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.293271 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ht6bt" podStartSLOduration=2.877879344 podStartE2EDuration="4.293252497s" podCreationTimestamp="2026-05-27 21:09:03 +0000 UTC" firstStartedPulling="2026-05-27 21:09:03.608622271 +0000 UTC m=+168.459071309" lastFinishedPulling="2026-05-27 21:09:05.023995411 +0000 UTC m=+169.874444462" observedRunningTime="2026-05-27 21:09:07.292381306 +0000 UTC m=+172.142830366" watchObservedRunningTime="2026-05-27 21:09:07.293252497 +0000 UTC m=+172.143701555" May 27 21:09:07.781385 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.781347 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8488fd6994-rx59w"] May 27 21:09:07.783959 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.783938 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.786711 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.786690 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 27 21:09:07.786828 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.786796 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 27 21:09:07.787820 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.787789 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9bel6u19ak7kb\"" May 27 21:09:07.787820 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.787794 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 27 21:09:07.787960 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.787859 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nxwjd\"" May 27 21:09:07.788163 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.788147 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 21:09:07.794683 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.794661 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8488fd6994-rx59w"] May 27 21:09:07.968462 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a2cd93bb-697b-4136-b18c-135046942354-metrics-server-audit-profiles\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.968462 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2cd93bb-697b-4136-b18c-135046942354-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.968693 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-secret-metrics-server-client-certs\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.968693 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkvb9\" (UniqueName: \"kubernetes.io/projected/a2cd93bb-697b-4136-b18c-135046942354-kube-api-access-zkvb9\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.968693 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a2cd93bb-697b-4136-b18c-135046942354-audit-log\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.968693 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-secret-metrics-server-tls\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:07.968693 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:07.968637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-client-ca-bundle\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069408 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069303 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-client-ca-bundle\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a2cd93bb-697b-4136-b18c-135046942354-metrics-server-audit-profiles\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069439 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2cd93bb-697b-4136-b18c-135046942354-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069484 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-secret-metrics-server-client-certs\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069514 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkvb9\" (UniqueName: \"kubernetes.io/projected/a2cd93bb-697b-4136-b18c-135046942354-kube-api-access-zkvb9\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069577 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a2cd93bb-697b-4136-b18c-135046942354-audit-log\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.069853 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.069604 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-secret-metrics-server-tls\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.070291 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.070264 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a2cd93bb-697b-4136-b18c-135046942354-audit-log\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.070430 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.070326 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2cd93bb-697b-4136-b18c-135046942354-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.070601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.070570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a2cd93bb-697b-4136-b18c-135046942354-metrics-server-audit-profiles\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.072478 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.072457 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-secret-metrics-server-tls\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.072592 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.072475 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-client-ca-bundle\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.072981 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.072956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a2cd93bb-697b-4136-b18c-135046942354-secret-metrics-server-client-certs\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.079312 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.079291 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkvb9\" (UniqueName: \"kubernetes.io/projected/a2cd93bb-697b-4136-b18c-135046942354-kube-api-access-zkvb9\") pod \"metrics-server-8488fd6994-rx59w\" (UID: \"a2cd93bb-697b-4136-b18c-135046942354\") " pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.095292 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.095256 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:08.264046 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:08.263975 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8488fd6994-rx59w"] May 27 21:09:08.272801 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:09:08.272764 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2cd93bb_697b_4136_b18c_135046942354.slice/crio-e1ddfcf655cb3c0be0bb884eb5d82c7289b400bdef6e3614d28fe8de8c9086c7 WatchSource:0}: Error finding container e1ddfcf655cb3c0be0bb884eb5d82c7289b400bdef6e3614d28fe8de8c9086c7: Status 404 returned error can't find the container with id e1ddfcf655cb3c0be0bb884eb5d82c7289b400bdef6e3614d28fe8de8c9086c7 May 27 21:09:09.241993 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.241854 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f"} May 27 21:09:09.241993 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.241962 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73"} May 27 21:09:09.241993 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.241981 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6"} May 27 21:09:09.241993 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.241995 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe"} May 27 21:09:09.242295 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.242007 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e"} May 27 21:09:09.243438 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.243405 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" event={"ID":"a2cd93bb-697b-4136-b18c-135046942354","Type":"ContainerStarted","Data":"e1ddfcf655cb3c0be0bb884eb5d82c7289b400bdef6e3614d28fe8de8c9086c7"} May 27 21:09:09.243575 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.243534 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9589c648-p9njm"] May 27 21:09:09.247109 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.247088 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.250414 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.250390 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 21:09:09.250522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.250465 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 21:09:09.250861 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.250837 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 21:09:09.250981 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.250864 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 21:09:09.251527 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.251508 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rtrd4\"" May 27 21:09:09.251663 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.251549 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 21:09:09.251663 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.251564 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 21:09:09.251887 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.251866 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 21:09:09.263978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.262110 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9589c648-p9njm"] May 27 21:09:09.265756 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.265727 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 21:09:09.383449 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-service-ca\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.383619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-serving-cert\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.383619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383566 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjqb\" (UniqueName: \"kubernetes.io/projected/ad0acd10-9341-4768-b474-2b5a3140e276-kube-api-access-swjqb\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.383619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-console-config\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.383766 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-oauth-serving-cert\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.383826 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-oauth-config\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.383826 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.383806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-trusted-ca-bundle\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.479477 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.479439 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:09:09.483750 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.483723 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.484596 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.484572 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-trusted-ca-bundle\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.484796 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.484768 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-service-ca\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.484944 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.484849 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-serving-cert\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.484944 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.484881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swjqb\" (UniqueName: \"kubernetes.io/projected/ad0acd10-9341-4768-b474-2b5a3140e276-kube-api-access-swjqb\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485075 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.484914 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-console-config\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485131 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.485074 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-oauth-serving-cert\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485131 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.485102 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-oauth-config\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485544 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.485517 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-trusted-ca-bundle\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485544 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.485531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-service-ca\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485834 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.485812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-oauth-serving-cert\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.485977 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.485949 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-console-config\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.486407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.486384 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-326s3rm4krd90\"" May 27 21:09:09.486494 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.486410 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 21:09:09.486746 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.486729 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 21:09:09.487043 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.487019 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wq5qk\"" May 27 21:09:09.487344 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.487324 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 21:09:09.487421 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.487406 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.487711 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.487836 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.487865 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-oauth-config\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.488003 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.488033 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.488097 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 21:09:09.488181 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.488122 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-serving-cert\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.488602 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.488200 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 21:09:09.488602 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.488412 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 21:09:09.489748 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.489728 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 21:09:09.493123 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.493075 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjqb\" (UniqueName: \"kubernetes.io/projected/ad0acd10-9341-4768-b474-2b5a3140e276-kube-api-access-swjqb\") pod \"console-6b9589c648-p9njm\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.499627 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.499608 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:09:09.559658 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.559624 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:09.586473 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-config\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586640 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586640 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-web-config\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586640 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586640 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586713 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-config-out\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.586818 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-849fj\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-kube-api-access-849fj\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586869 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.586915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.587001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.587036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.587060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.587090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.587144 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.587122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688017 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.687977 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-config\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688204 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688026 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688204 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688055 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-web-config\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688204 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688082 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688204 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688114 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688204 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688179 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688207 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688236 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688264 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-config-out\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688288 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-849fj\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-kube-api-access-849fj\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688350 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688379 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688427 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688836 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688462 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688836 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688488 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688836 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688522 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.688836 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.688566 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.689080 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.689031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.689942 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.689898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.690540 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.690517 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.691509 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.691409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-web-config\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.692049 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.692028 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.693566 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.692965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.693666 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.693619 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.694188 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.693872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-config\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.694188 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.694021 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.694188 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.694112 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.694867 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.694613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-config-out\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.694867 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.694829 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.695292 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.695266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.695703 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.695659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.697417 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.697389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.697500 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.697427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.698199 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.698172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.707276 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.707252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-849fj\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-kube-api-access-849fj\") pod \"prometheus-k8s-0\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:09.809183 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:09.809147 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:10.018512 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.018463 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:09:10.022349 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:09:10.022292 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206e293f_088d_49b0_9f4d_d32e4ecb3720.slice/crio-a401602937ab3b876d8a38b313cf4891e592876076d34e8b43c6fc3a3bdcf391 WatchSource:0}: Error finding container a401602937ab3b876d8a38b313cf4891e592876076d34e8b43c6fc3a3bdcf391: Status 404 returned error can't find the container with id a401602937ab3b876d8a38b313cf4891e592876076d34e8b43c6fc3a3bdcf391 May 27 21:09:10.029067 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.029034 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9589c648-p9njm"] May 27 21:09:10.033594 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:09:10.033558 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0acd10_9341_4768_b474_2b5a3140e276.slice/crio-1eec67cfcfd07c883258effe3e2c290c02fe1b792b29eade7ffa9fb8eb0e0703 WatchSource:0}: Error finding container 1eec67cfcfd07c883258effe3e2c290c02fe1b792b29eade7ffa9fb8eb0e0703: Status 404 returned error can't find the container with id 1eec67cfcfd07c883258effe3e2c290c02fe1b792b29eade7ffa9fb8eb0e0703 May 27 21:09:10.180343 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.180305 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-njhk2" May 27 21:09:10.247938 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.247894 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9589c648-p9njm" event={"ID":"ad0acd10-9341-4768-b474-2b5a3140e276","Type":"ContainerStarted","Data":"1eec67cfcfd07c883258effe3e2c290c02fe1b792b29eade7ffa9fb8eb0e0703"} May 27 21:09:10.249295 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.249269 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" exitCode=0 May 27 21:09:10.249425 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.249349 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} May 27 21:09:10.249425 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.249379 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"a401602937ab3b876d8a38b313cf4891e592876076d34e8b43c6fc3a3bdcf391"} May 27 21:09:10.250785 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.250755 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" event={"ID":"a2cd93bb-697b-4136-b18c-135046942354","Type":"ContainerStarted","Data":"fbf1b28d4c9e67a3cdd1beba5352efb71725a624724d3fb82fb58ad1f5f9ce02"} May 27 21:09:10.331388 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:10.331327 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" podStartSLOduration=1.700199566 podStartE2EDuration="3.331309995s" podCreationTimestamp="2026-05-27 21:09:07 +0000 UTC" firstStartedPulling="2026-05-27 21:09:08.275305991 +0000 UTC m=+173.125755028" lastFinishedPulling="2026-05-27 21:09:09.906416413 +0000 UTC m=+174.756865457" observedRunningTime="2026-05-27 21:09:10.329086045 +0000 UTC m=+175.179535113" watchObservedRunningTime="2026-05-27 21:09:10.331309995 +0000 UTC m=+175.181759052" May 27 21:09:11.261154 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:11.261098 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerStarted","Data":"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820"} May 27 21:09:11.300329 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:11.300260 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.252560039 podStartE2EDuration="7.30023866s" podCreationTimestamp="2026-05-27 21:09:04 +0000 UTC" firstStartedPulling="2026-05-27 21:09:05.216868185 +0000 UTC m=+170.067317233" lastFinishedPulling="2026-05-27 21:09:10.264546804 +0000 UTC m=+175.114995854" observedRunningTime="2026-05-27 21:09:11.296913314 +0000 UTC m=+176.147362383" watchObservedRunningTime="2026-05-27 21:09:11.30023866 +0000 UTC m=+176.150687718" May 27 21:09:14.277673 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:14.277631 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9589c648-p9njm" event={"ID":"ad0acd10-9341-4768-b474-2b5a3140e276","Type":"ContainerStarted","Data":"2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a"} May 27 21:09:14.279880 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:14.279851 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} May 27 21:09:14.299357 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:14.299301 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b9589c648-p9njm" podStartSLOduration=1.195512503 podStartE2EDuration="5.299283119s" podCreationTimestamp="2026-05-27 21:09:09 +0000 UTC" firstStartedPulling="2026-05-27 21:09:10.035792109 +0000 UTC m=+174.886241145" lastFinishedPulling="2026-05-27 21:09:14.139562713 +0000 UTC m=+178.990011761" observedRunningTime="2026-05-27 21:09:14.297649894 +0000 UTC m=+179.148098952" watchObservedRunningTime="2026-05-27 21:09:14.299283119 +0000 UTC m=+179.149732176" May 27 21:09:15.284663 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:15.284631 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} May 27 21:09:15.297301 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:15.297265 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9589c648-p9njm"] May 27 21:09:15.692480 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:15.692368 2566 patch_prober.go:28] interesting pod/image-registry-7c564c7797-gg7d4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 27 21:09:15.692729 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:15.692459 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" podUID="91a159b4-d132-4626-97e8-3b96f3839ab6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 21:09:16.290981 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:16.290939 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} May 27 21:09:16.291442 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:16.290988 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} May 27 21:09:16.291442 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:16.291002 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} May 27 21:09:16.291442 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:16.291014 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerStarted","Data":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} May 27 21:09:16.332975 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:16.332706 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.587033208 podStartE2EDuration="7.332685128s" podCreationTimestamp="2026-05-27 21:09:09 +0000 UTC" firstStartedPulling="2026-05-27 21:09:10.261964169 +0000 UTC m=+175.112413218" lastFinishedPulling="2026-05-27 21:09:16.007616092 +0000 UTC m=+180.858065138" observedRunningTime="2026-05-27 21:09:16.332093803 +0000 UTC m=+181.182542862" watchObservedRunningTime="2026-05-27 21:09:16.332685128 +0000 UTC m=+181.183134186" May 27 21:09:17.166581 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:17.166547 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c564c7797-gg7d4" May 27 21:09:19.559838 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:19.559792 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:19.810222 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:19.810136 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:09:28.095427 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:28.095385 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:28.095427 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:28.095430 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:41.310039 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.309999 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b9589c648-p9njm" podUID="ad0acd10-9341-4768-b474-2b5a3140e276" containerName="console" containerID="cri-o://2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a" gracePeriod=15 May 27 21:09:41.571043 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.570965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9589c648-p9njm_ad0acd10-9341-4768-b474-2b5a3140e276/console/0.log" May 27 21:09:41.571195 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.571050 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:41.694629 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.694589 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-oauth-config\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.694808 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.694649 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-oauth-serving-cert\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.694861 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.694811 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-service-ca\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.694906 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.694860 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swjqb\" (UniqueName: \"kubernetes.io/projected/ad0acd10-9341-4768-b474-2b5a3140e276-kube-api-access-swjqb\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.694987 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.694903 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-serving-cert\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.694987 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.694961 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-trusted-ca-bundle\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.695100 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695005 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-console-config\") pod \"ad0acd10-9341-4768-b474-2b5a3140e276\" (UID: \"ad0acd10-9341-4768-b474-2b5a3140e276\") " May 27 21:09:41.695156 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695135 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:41.695376 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695209 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:41.695492 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695409 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:41.695492 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695415 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-console-config" (OuterVolumeSpecName: "console-config") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:41.695492 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695456 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-oauth-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:41.695492 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.695477 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-service-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:41.697293 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.697268 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:09:41.697404 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.697294 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:09:41.697404 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.697304 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0acd10-9341-4768-b474-2b5a3140e276-kube-api-access-swjqb" (OuterVolumeSpecName: "kube-api-access-swjqb") pod "ad0acd10-9341-4768-b474-2b5a3140e276" (UID: "ad0acd10-9341-4768-b474-2b5a3140e276"). InnerVolumeSpecName "kube-api-access-swjqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:09:41.796282 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.796232 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-oauth-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:41.796282 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.796274 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swjqb\" (UniqueName: \"kubernetes.io/projected/ad0acd10-9341-4768-b474-2b5a3140e276-kube-api-access-swjqb\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:41.796282 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.796284 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0acd10-9341-4768-b474-2b5a3140e276-console-serving-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:41.796282 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.796293 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:41.796282 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:41.796302 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0acd10-9341-4768-b474-2b5a3140e276-console-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:09:42.375831 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.375798 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9589c648-p9njm_ad0acd10-9341-4768-b474-2b5a3140e276/console/0.log" May 27 21:09:42.376330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.375843 2566 generic.go:358] "Generic (PLEG): container finished" podID="ad0acd10-9341-4768-b474-2b5a3140e276" containerID="2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a" exitCode=2 May 27 21:09:42.376330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.375903 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9589c648-p9njm" event={"ID":"ad0acd10-9341-4768-b474-2b5a3140e276","Type":"ContainerDied","Data":"2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a"} May 27 21:09:42.376330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.375912 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9589c648-p9njm" May 27 21:09:42.376330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.375971 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9589c648-p9njm" event={"ID":"ad0acd10-9341-4768-b474-2b5a3140e276","Type":"ContainerDied","Data":"1eec67cfcfd07c883258effe3e2c290c02fe1b792b29eade7ffa9fb8eb0e0703"} May 27 21:09:42.376330 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.375995 2566 scope.go:117] "RemoveContainer" containerID="2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a" May 27 21:09:42.384224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.384204 2566 scope.go:117] "RemoveContainer" containerID="2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a" May 27 21:09:42.384544 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:09:42.384520 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a\": container with ID starting with 2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a not found: ID does not exist" containerID="2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a" May 27 21:09:42.384639 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.384550 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a"} err="failed to get container status \"2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a\": rpc error: code = NotFound desc = could not find container \"2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a\": container with ID starting with 2652078ed207cb472ee4970ba7142f8a1ce89755f834437f5266bb95f4f5df8a not found: ID does not exist" May 27 21:09:42.398334 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.398298 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9589c648-p9njm"] May 27 21:09:42.403243 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:42.403205 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9589c648-p9njm"] May 27 21:09:43.696510 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:43.696477 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0acd10-9341-4768-b474-2b5a3140e276" path="/var/lib/kubelet/pods/ad0acd10-9341-4768-b474-2b5a3140e276/volumes" May 27 21:09:48.101203 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:48.101172 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:09:48.105139 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:09:48.105117 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8488fd6994-rx59w" May 27 21:10:09.810172 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:09.810117 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:09.826132 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:09.826103 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:10.478810 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:10.478784 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:23.691407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.691367 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:10:23.691882 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.691798 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="alertmanager" containerID="cri-o://aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e" gracePeriod=120 May 27 21:10:23.691978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.691875 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-web" containerID="cri-o://da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6" gracePeriod=120 May 27 21:10:23.691978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.691941 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy" containerID="cri-o://89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73" gracePeriod=120 May 27 21:10:23.692073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.691960 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="config-reloader" containerID="cri-o://1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe" gracePeriod=120 May 27 21:10:23.692073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.691875 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-metric" containerID="cri-o://26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f" gracePeriod=120 May 27 21:10:23.692803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:23.692197 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="prom-label-proxy" containerID="cri-o://1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820" gracePeriod=120 May 27 21:10:24.508359 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508321 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820" exitCode=0 May 27 21:10:24.508359 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508347 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73" exitCode=0 May 27 21:10:24.508359 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508354 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe" exitCode=0 May 27 21:10:24.508359 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508360 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e" exitCode=0 May 27 21:10:24.508631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508388 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820"} May 27 21:10:24.508631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508421 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73"} May 27 21:10:24.508631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508433 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe"} May 27 21:10:24.508631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.508444 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e"} May 27 21:10:24.940670 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.940645 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:24.991556 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991524 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.991742 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991586 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.991742 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991708 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-main-db\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.991860 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991772 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-cluster-tls-config\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.991860 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991809 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-main-tls\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.991860 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991840 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-web-config\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992046 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991864 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-tls-assets\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992046 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991887 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-out\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992046 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.991982 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fk54\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-kube-api-access-8fk54\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992046 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.992016 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-metrics-client-ca\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992046 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.992034 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:10:24.992305 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.992077 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-volume\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992305 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.992107 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-trusted-ca-bundle\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992305 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.992143 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-web\") pod \"e4510a25-c6bb-4760-83f6-cd6e47549d44\" (UID: \"e4510a25-c6bb-4760-83f6-cd6e47549d44\") " May 27 21:10:24.992455 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.992428 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-main-db\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:24.993466 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.993195 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:24.996909 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.995044 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:24.996909 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.995841 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:24.996909 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.996010 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:24.996909 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.996036 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:24.996909 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.996053 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-volume" (OuterVolumeSpecName: "config-volume") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:24.996909 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.996278 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:24.997313 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.996973 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-out" (OuterVolumeSpecName: "config-out") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:10:24.997376 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.997313 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:10:24.998504 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:24.998467 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-kube-api-access-8fk54" (OuterVolumeSpecName: "kube-api-access-8fk54") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "kube-api-access-8fk54". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:10:25.002211 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.002148 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:25.007625 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.007602 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-web-config" (OuterVolumeSpecName: "web-config") pod "e4510a25-c6bb-4760-83f6-cd6e47549d44" (UID: "e4510a25-c6bb-4760-83f6-cd6e47549d44"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:25.092828 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092781 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fk54\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-kube-api-access-8fk54\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.092828 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092819 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-metrics-client-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.092828 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092829 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-volume\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.092828 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092838 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4510a25-c6bb-4760-83f6-cd6e47549d44-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092849 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092857 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092867 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092879 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-cluster-tls-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092888 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-secret-alertmanager-main-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092898 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4510a25-c6bb-4760-83f6-cd6e47549d44-web-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092907 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4510a25-c6bb-4760-83f6-cd6e47549d44-tls-assets\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.093134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.092915 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4510a25-c6bb-4760-83f6-cd6e47549d44-config-out\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:25.517690 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517596 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f" exitCode=0 May 27 21:10:25.517690 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517627 2566 generic.go:358] "Generic (PLEG): container finished" podID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerID="da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6" exitCode=0 May 27 21:10:25.517690 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517672 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f"} May 27 21:10:25.517955 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517704 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.517955 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517722 2566 scope.go:117] "RemoveContainer" containerID="1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820" May 27 21:10:25.517955 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517710 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6"} May 27 21:10:25.517955 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.517854 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4510a25-c6bb-4760-83f6-cd6e47549d44","Type":"ContainerDied","Data":"461a0b4bb1bec75ea3ac4135d8c257caa170692487f6e4d53010233a7c6937c5"} May 27 21:10:25.525019 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.524996 2566 scope.go:117] "RemoveContainer" containerID="26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f" May 27 21:10:25.531682 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.531664 2566 scope.go:117] "RemoveContainer" containerID="89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73" May 27 21:10:25.538426 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.538407 2566 scope.go:117] "RemoveContainer" containerID="da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6" May 27 21:10:25.544117 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.544090 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:10:25.546209 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.546184 2566 scope.go:117] "RemoveContainer" containerID="1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe" May 27 21:10:25.548162 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.548136 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:10:25.553173 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.553157 2566 scope.go:117] "RemoveContainer" containerID="aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e" May 27 21:10:25.559830 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.559810 2566 scope.go:117] "RemoveContainer" containerID="9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287" May 27 21:10:25.566262 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.566239 2566 scope.go:117] "RemoveContainer" containerID="1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820" May 27 21:10:25.566522 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.566503 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820\": container with ID starting with 1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820 not found: ID does not exist" containerID="1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820" May 27 21:10:25.566582 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.566532 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820"} err="failed to get container status \"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820\": rpc error: code = NotFound desc = could not find container \"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820\": container with ID starting with 1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820 not found: ID does not exist" May 27 21:10:25.566582 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.566552 2566 scope.go:117] "RemoveContainer" containerID="26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f" May 27 21:10:25.566796 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.566778 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f\": container with ID starting with 26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f not found: ID does not exist" containerID="26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f" May 27 21:10:25.566842 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.566803 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f"} err="failed to get container status \"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f\": rpc error: code = NotFound desc = could not find container \"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f\": container with ID starting with 26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f not found: ID does not exist" May 27 21:10:25.566842 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.566820 2566 scope.go:117] "RemoveContainer" containerID="89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73" May 27 21:10:25.567050 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.567032 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73\": container with ID starting with 89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73 not found: ID does not exist" containerID="89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73" May 27 21:10:25.567130 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567061 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73"} err="failed to get container status \"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73\": rpc error: code = NotFound desc = could not find container \"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73\": container with ID starting with 89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73 not found: ID does not exist" May 27 21:10:25.567130 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567084 2566 scope.go:117] "RemoveContainer" containerID="da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6" May 27 21:10:25.567319 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.567303 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6\": container with ID starting with da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6 not found: ID does not exist" containerID="da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6" May 27 21:10:25.567357 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567323 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6"} err="failed to get container status \"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6\": rpc error: code = NotFound desc = could not find container \"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6\": container with ID starting with da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6 not found: ID does not exist" May 27 21:10:25.567357 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567338 2566 scope.go:117] "RemoveContainer" containerID="1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe" May 27 21:10:25.567561 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.567545 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe\": container with ID starting with 1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe not found: ID does not exist" containerID="1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe" May 27 21:10:25.567599 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567567 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe"} err="failed to get container status \"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe\": rpc error: code = NotFound desc = could not find container \"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe\": container with ID starting with 1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe not found: ID does not exist" May 27 21:10:25.567599 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567581 2566 scope.go:117] "RemoveContainer" containerID="aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e" May 27 21:10:25.567765 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.567749 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e\": container with ID starting with aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e not found: ID does not exist" containerID="aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e" May 27 21:10:25.567834 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567774 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e"} err="failed to get container status \"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e\": rpc error: code = NotFound desc = could not find container \"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e\": container with ID starting with aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e not found: ID does not exist" May 27 21:10:25.567834 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.567793 2566 scope.go:117] "RemoveContainer" containerID="9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287" May 27 21:10:25.568030 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:25.568014 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287\": container with ID starting with 9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287 not found: ID does not exist" containerID="9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287" May 27 21:10:25.568083 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568037 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287"} err="failed to get container status \"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287\": rpc error: code = NotFound desc = could not find container \"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287\": container with ID starting with 9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287 not found: ID does not exist" May 27 21:10:25.568083 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568051 2566 scope.go:117] "RemoveContainer" containerID="1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820" May 27 21:10:25.568268 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568250 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820"} err="failed to get container status \"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820\": rpc error: code = NotFound desc = could not find container \"1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820\": container with ID starting with 1318d11053685ada3b6cc564c87a4fe18d833fd95281f7c0f1ce3c8045ac8820 not found: ID does not exist" May 27 21:10:25.568315 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568270 2566 scope.go:117] "RemoveContainer" containerID="26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f" May 27 21:10:25.568454 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568439 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f"} err="failed to get container status \"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f\": rpc error: code = NotFound desc = could not find container \"26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f\": container with ID starting with 26db37734a678a51b446c618a86d3384bb35c88a6d362904629e564ad3c7fc6f not found: ID does not exist" May 27 21:10:25.568497 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568454 2566 scope.go:117] "RemoveContainer" containerID="89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73" May 27 21:10:25.568668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568651 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73"} err="failed to get container status \"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73\": rpc error: code = NotFound desc = could not find container \"89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73\": container with ID starting with 89d1488f43b8931f4d5b9e0fac97871581947e3992382957bae74dc3a6d67a73 not found: ID does not exist" May 27 21:10:25.568707 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568669 2566 scope.go:117] "RemoveContainer" containerID="da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6" May 27 21:10:25.568848 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568834 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6"} err="failed to get container status \"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6\": rpc error: code = NotFound desc = could not find container \"da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6\": container with ID starting with da31848e5692d0d3742c48f78322a83b83d4ae729028e25e28a4da6b0d3a3fe6 not found: ID does not exist" May 27 21:10:25.568892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.568848 2566 scope.go:117] "RemoveContainer" containerID="1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe" May 27 21:10:25.569035 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.569017 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe"} err="failed to get container status \"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe\": rpc error: code = NotFound desc = could not find container \"1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe\": container with ID starting with 1ee066240b264adf82ac9d39ebb731f2f51ef02223992c2ce0bbed3d51b086fe not found: ID does not exist" May 27 21:10:25.569109 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.569038 2566 scope.go:117] "RemoveContainer" containerID="aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e" May 27 21:10:25.569239 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.569222 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e"} err="failed to get container status \"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e\": rpc error: code = NotFound desc = could not find container \"aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e\": container with ID starting with aae709e3c744288117bb2e7ae0b9e423cd492cfaf71023fd5628a66decb3069e not found: ID does not exist" May 27 21:10:25.569284 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.569240 2566 scope.go:117] "RemoveContainer" containerID="9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287" May 27 21:10:25.569437 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.569418 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287"} err="failed to get container status \"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287\": rpc error: code = NotFound desc = could not find container \"9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287\": container with ID starting with 9ee10d60d6ba3c04fde3edbb5356bb2f59babadb8955f33780445563dd12e287 not found: ID does not exist" May 27 21:10:25.696086 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:25.696053 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" path="/var/lib/kubelet/pods/e4510a25-c6bb-4760-83f6-cd6e47549d44/volumes" May 27 21:10:27.513238 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.513195 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:10:27.515561 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.515520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb39e458-d2d6-4bb3-bf78-ef0e06839905-metrics-certs\") pod \"network-metrics-daemon-2ts5d\" (UID: \"eb39e458-d2d6-4bb3-bf78-ef0e06839905\") " pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:10:27.602506 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.602468 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvnhn\"" May 27 21:10:27.610247 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.610223 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ts5d" May 27 21:10:27.743365 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.743296 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2ts5d"] May 27 21:10:27.745887 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:10:27.745860 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb39e458_d2d6_4bb3_bf78_ef0e06839905.slice/crio-569f3accfd16e3930f46019c9574b0f3d1147233091cbf0b567e342dbdd465f4 WatchSource:0}: Error finding container 569f3accfd16e3930f46019c9574b0f3d1147233091cbf0b567e342dbdd465f4: Status 404 returned error can't find the container with id 569f3accfd16e3930f46019c9574b0f3d1147233091cbf0b567e342dbdd465f4 May 27 21:10:27.997650 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.997620 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:10:27.998108 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.998077 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="prometheus" containerID="cri-o://f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" gracePeriod=600 May 27 21:10:27.998224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.998113 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" gracePeriod=600 May 27 21:10:27.998224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.998112 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="thanos-sidecar" containerID="cri-o://f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" gracePeriod=600 May 27 21:10:27.998224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.998131 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-web" containerID="cri-o://05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" gracePeriod=600 May 27 21:10:27.998224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.998088 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy" containerID="cri-o://86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" gracePeriod=600 May 27 21:10:27.998224 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:27.998167 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="config-reloader" containerID="cri-o://40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" gracePeriod=600 May 27 21:10:28.254787 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.254721 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.320452 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320401 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-serving-certs-ca-bundle\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.320630 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320463 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-kubelet-serving-ca-bundle\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.320630 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320496 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-kube-rbac-proxy\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.320630 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320520 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-rulefiles-0\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.320630 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320577 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-tls-assets\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.320950 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320894 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:28.320950 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.320828 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-config-out\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.321064 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.321005 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:28.321126 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.321000 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-trusted-ca-bundle\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.321190 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.321165 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.321488 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.321457 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.321208 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-thanos-prometheus-http-client-file\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322191 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-metrics-client-ca\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322229 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-tls\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322268 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-config\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322294 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-grpc-tls\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322333 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322371 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-metrics-client-certs\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322395 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-849fj\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-kube-api-access-849fj\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322437 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-web-config\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322460 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-db\") pod \"206e293f-088d-49b0-9f4d-d32e4ecb3720\" (UID: \"206e293f-088d-49b0-9f4d-d32e4ecb3720\") " May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322698 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322715 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.322731 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.323230 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.323072 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:10:28.324364 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.323434 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.324364 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.323553 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:28.324364 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.323837 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:28.325626 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.325506 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.325837 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.325791 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:10:28.326443 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.326408 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-config-out" (OuterVolumeSpecName: "config-out") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:10:28.326687 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.326661 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.326826 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.326805 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.326902 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.326824 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.327853 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.327811 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.328314 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.328287 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-kube-api-access-849fj" (OuterVolumeSpecName: "kube-api-access-849fj") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "kube-api-access-849fj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:10:28.328507 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.328486 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.328720 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.328689 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-config" (OuterVolumeSpecName: "config") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.339846 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.339814 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-web-config" (OuterVolumeSpecName: "web-config") pod "206e293f-088d-49b0-9f4d-d32e4ecb3720" (UID: "206e293f-088d-49b0-9f4d-d32e4ecb3720"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:28.423576 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423536 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-web-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423576 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423575 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-db\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423576 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423590 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-kube-rbac-proxy\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423638 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423650 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-tls-assets\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423662 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/206e293f-088d-49b0-9f4d-d32e4ecb3720-config-out\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423676 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423690 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423705 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/206e293f-088d-49b0-9f4d-d32e4ecb3720-configmap-metrics-client-ca\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423718 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423732 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-config\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423745 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-grpc-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423758 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423772 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/206e293f-088d-49b0-9f4d-d32e4ecb3720-secret-metrics-client-certs\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.423875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.423786 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-849fj\" (UniqueName: \"kubernetes.io/projected/206e293f-088d-49b0-9f4d-d32e4ecb3720-kube-api-access-849fj\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:10:28.532032 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.532001 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ts5d" event={"ID":"eb39e458-d2d6-4bb3-bf78-ef0e06839905","Type":"ContainerStarted","Data":"569f3accfd16e3930f46019c9574b0f3d1147233091cbf0b567e342dbdd465f4"} May 27 21:10:28.535321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535270 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" exitCode=0 May 27 21:10:28.535321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535298 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" exitCode=0 May 27 21:10:28.535321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535307 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" exitCode=0 May 27 21:10:28.535321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535315 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" exitCode=0 May 27 21:10:28.535321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535322 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" exitCode=0 May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535330 2566 generic.go:358] "Generic (PLEG): container finished" podID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" exitCode=0 May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535358 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535406 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535419 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535437 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535423 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535561 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535584 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535600 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} May 27 21:10:28.535632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.535615 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"206e293f-088d-49b0-9f4d-d32e4ecb3720","Type":"ContainerDied","Data":"a401602937ab3b876d8a38b313cf4891e592876076d34e8b43c6fc3a3bdcf391"} May 27 21:10:28.563531 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.563492 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:10:28.569006 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.568975 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:10:28.604509 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604475 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:10:28.604744 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604732 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="init-config-reloader" May 27 21:10:28.604792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604749 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="init-config-reloader" May 27 21:10:28.604792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604760 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="config-reloader" May 27 21:10:28.604792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604766 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="config-reloader" May 27 21:10:28.604792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604779 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="prom-label-proxy" May 27 21:10:28.604792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604785 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="prom-label-proxy" May 27 21:10:28.604792 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604791 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="alertmanager" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604797 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="alertmanager" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604805 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0acd10-9341-4768-b474-2b5a3140e276" containerName="console" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604812 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0acd10-9341-4768-b474-2b5a3140e276" containerName="console" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604823 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-thanos" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604831 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-thanos" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604841 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604847 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604854 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="thanos-sidecar" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604860 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="thanos-sidecar" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604867 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604872 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604878 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="prometheus" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604885 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="prometheus" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604890 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-web" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604894 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-web" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604900 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-metric" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604904 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-metric" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604912 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-web" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604930 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-web" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604942 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="config-reloader" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604949 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="config-reloader" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604955 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="init-config-reloader" May 27 21:10:28.604978 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.604960 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="init-config-reloader" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605007 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605014 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-web" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605021 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="prometheus" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605027 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="config-reloader" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605033 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="config-reloader" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605039 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad0acd10-9341-4768-b474-2b5a3140e276" containerName="console" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605045 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="kube-rbac-proxy-metric" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605052 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605058 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-thanos" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605064 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="kube-rbac-proxy-web" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605070 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="alertmanager" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605076 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" containerName="thanos-sidecar" May 27 21:10:28.605601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.605081 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4510a25-c6bb-4760-83f6-cd6e47549d44" containerName="prom-label-proxy" May 27 21:10:28.607672 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.607626 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.608533 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.608516 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.610511 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.610418 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 21:10:28.610511 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.610422 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 21:10:28.610793 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.610766 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 21:10:28.610868 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.610791 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 21:10:28.611089 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611047 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 21:10:28.611179 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611106 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 21:10:28.611245 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611193 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 21:10:28.611245 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611200 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 21:10:28.611386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611242 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-326s3rm4krd90\"" May 27 21:10:28.611386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611296 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 21:10:28.611386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611355 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wq5qk\"" May 27 21:10:28.611659 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.611640 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 21:10:28.614170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.614148 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 21:10:28.615375 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.615356 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 21:10:28.617613 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.617503 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.622945 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.622907 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:10:28.626369 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626468 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626468 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626468 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626468 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626465 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626594 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626594 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-config\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626594 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626547 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61d80059-54de-4c6a-950b-dec84198de18-config-out\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626594 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-web-config\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626706 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626706 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626706 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626793 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626793 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61d80059-54de-4c6a-950b-dec84198de18-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626793 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626890 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626890 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz6dh\" (UniqueName: \"kubernetes.io/projected/61d80059-54de-4c6a-950b-dec84198de18-kube-api-access-nz6dh\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.626890 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.626878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61d80059-54de-4c6a-950b-dec84198de18-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.633658 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.633635 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.640796 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.640776 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.649028 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.649006 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.657513 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.657491 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.670601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.670568 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.670898 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.670875 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.671043 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.670905 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} err="failed to get container status \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" May 27 21:10:28.671122 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.671050 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.671343 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.671322 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.671428 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.671350 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} err="failed to get container status \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" May 27 21:10:28.671428 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.671374 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.671653 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.671621 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.671727 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.671665 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} err="failed to get container status \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" May 27 21:10:28.671727 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.671690 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.672030 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.671999 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.672112 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672035 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} err="failed to get container status \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" May 27 21:10:28.672112 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672050 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.672360 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.672336 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.672425 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672365 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} err="failed to get container status \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" May 27 21:10:28.672425 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672382 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.672644 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.672623 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.672728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672650 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} err="failed to get container status \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" May 27 21:10:28.672728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672672 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.672963 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:10:28.672941 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.673043 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672970 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} err="failed to get container status \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" May 27 21:10:28.673043 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.672989 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.673214 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673194 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} err="failed to get container status \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" May 27 21:10:28.673273 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673216 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.673464 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673439 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} err="failed to get container status \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" May 27 21:10:28.673522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673465 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.673684 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673667 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} err="failed to get container status \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" May 27 21:10:28.673758 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673687 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.673971 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673944 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} err="failed to get container status \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" May 27 21:10:28.674048 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.673972 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.674210 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674191 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} err="failed to get container status \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" May 27 21:10:28.674303 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674211 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.674505 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674466 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} err="failed to get container status \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" May 27 21:10:28.674505 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674491 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.674765 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674719 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} err="failed to get container status \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" May 27 21:10:28.674853 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674768 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.675025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.674999 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} err="failed to get container status \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" May 27 21:10:28.675025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675024 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.675285 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675254 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} err="failed to get container status \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" May 27 21:10:28.675285 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675277 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675489 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} err="failed to get container status \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675516 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675790 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} err="failed to get container status \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.675812 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.676039 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} err="failed to get container status \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.676059 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.676427 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} err="failed to get container status \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" May 27 21:10:28.676453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.676449 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.676975 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.676647 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} err="failed to get container status \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" May 27 21:10:28.676975 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.676669 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.677080 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677001 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} err="failed to get container status \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" May 27 21:10:28.677080 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677025 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.677312 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677285 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} err="failed to get container status \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" May 27 21:10:28.677312 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677311 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.677555 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677529 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} err="failed to get container status \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" May 27 21:10:28.677555 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677555 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.677837 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677796 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} err="failed to get container status \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" May 27 21:10:28.677940 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.677840 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.678130 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.678071 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} err="failed to get container status \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" May 27 21:10:28.678234 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.678106 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.678574 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.678546 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} err="failed to get container status \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" May 27 21:10:28.678574 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.678573 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.678836 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.678814 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} err="failed to get container status \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" May 27 21:10:28.678954 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.678837 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.679082 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.679064 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} err="failed to get container status \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" May 27 21:10:28.679188 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.679084 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.679386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.679368 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} err="failed to get container status \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" May 27 21:10:28.679492 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.679390 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.679625 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.679608 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} err="failed to get container status \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" May 27 21:10:28.679732 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.679627 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.680103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680078 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} err="failed to get container status \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" May 27 21:10:28.680200 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680105 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.680377 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680350 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} err="failed to get container status \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" May 27 21:10:28.680448 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680378 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.680647 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680622 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} err="failed to get container status \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" May 27 21:10:28.680706 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680649 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.680899 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680870 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} err="failed to get container status \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" May 27 21:10:28.680899 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.680898 2566 scope.go:117] "RemoveContainer" containerID="ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10" May 27 21:10:28.681280 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.681257 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10"} err="failed to get container status \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": rpc error: code = NotFound desc = could not find container \"ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10\": container with ID starting with ae1d1bd3d71080d607f72a1c0e5f32e5e3d5ab80fbdfe6a5be7355726064fc10 not found: ID does not exist" May 27 21:10:28.681379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.681282 2566 scope.go:117] "RemoveContainer" containerID="86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29" May 27 21:10:28.681550 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.681492 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29"} err="failed to get container status \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": rpc error: code = NotFound desc = could not find container \"86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29\": container with ID starting with 86f76b02b396f9c00666d6f24ccd5592a11097972fed67235e8035f1fa385e29 not found: ID does not exist" May 27 21:10:28.681550 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.681517 2566 scope.go:117] "RemoveContainer" containerID="05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a" May 27 21:10:28.681830 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.681720 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a"} err="failed to get container status \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": rpc error: code = NotFound desc = could not find container \"05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a\": container with ID starting with 05880cd07e7e1530a0e2ff7da042838fd38291d923704f69198cacb42a79478a not found: ID does not exist" May 27 21:10:28.681830 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.681748 2566 scope.go:117] "RemoveContainer" containerID="f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410" May 27 21:10:28.682032 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682007 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410"} err="failed to get container status \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": rpc error: code = NotFound desc = could not find container \"f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410\": container with ID starting with f05a7e5f56b28b0ca41d55e8de4770e0c403378fa7262ca600364bfbf1128410 not found: ID does not exist" May 27 21:10:28.682109 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682034 2566 scope.go:117] "RemoveContainer" containerID="40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8" May 27 21:10:28.682321 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682292 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8"} err="failed to get container status \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": rpc error: code = NotFound desc = could not find container \"40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8\": container with ID starting with 40ec25ff8bcc5e1d6909f2066eeac260651662e8c8a275276d84ca4fb12b0ae8 not found: ID does not exist" May 27 21:10:28.682383 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682320 2566 scope.go:117] "RemoveContainer" containerID="f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873" May 27 21:10:28.682584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682554 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873"} err="failed to get container status \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": rpc error: code = NotFound desc = could not find container \"f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873\": container with ID starting with f3e05947e4237125975c0aad8d2917795e417ed192b98a8cbfd868b9f74e0873 not found: ID does not exist" May 27 21:10:28.682584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682582 2566 scope.go:117] "RemoveContainer" containerID="b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd" May 27 21:10:28.682852 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.682829 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd"} err="failed to get container status \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": rpc error: code = NotFound desc = could not find container \"b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd\": container with ID starting with b00bb77b3ddafbc0ab201e6c0a7d1822c8c5cc7e711ed6c19f37d75915912acd not found: ID does not exist" May 27 21:10:28.727633 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.727604 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.727808 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.727643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.727983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.727847 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.727983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.727905 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.727983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.727944 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-config\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.727983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.727984 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61d80059-54de-4c6a-950b-dec84198de18-config-out\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728215 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728004 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-web-config\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728215 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728026 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728215 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728084 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728215 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728150 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728215 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728189 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728222 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61d80059-54de-4c6a-950b-dec84198de18-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728250 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728278 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728302 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz6dh\" (UniqueName: \"kubernetes.io/projected/61d80059-54de-4c6a-950b-dec84198de18-kube-api-access-nz6dh\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728332 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61d80059-54de-4c6a-950b-dec84198de18-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728372 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.728484 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.728400 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.730807 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.730780 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61d80059-54de-4c6a-950b-dec84198de18-config-out\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.731528 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.731738 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.732351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.732354 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-web-config\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.732599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.732828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61d80059-54de-4c6a-950b-dec84198de18-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.733487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.733737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.734632 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.734445 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-config\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.735162 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.734724 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.735162 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.734998 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.736410 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.735717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.736410 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.736257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61d80059-54de-4c6a-950b-dec84198de18-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.736523 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.736435 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.737073 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.737050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61d80059-54de-4c6a-950b-dec84198de18-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.737271 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.737254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61d80059-54de-4c6a-950b-dec84198de18-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.750660 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.750632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz6dh\" (UniqueName: \"kubernetes.io/projected/61d80059-54de-4c6a-950b-dec84198de18-kube-api-access-nz6dh\") pod \"prometheus-k8s-0\" (UID: \"61d80059-54de-4c6a-950b-dec84198de18\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:28.919318 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:28.919277 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:10:29.059337 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.059247 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:10:29.062252 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:10:29.062218 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d80059_54de_4c6a_950b_dec84198de18.slice/crio-9000b1f34e6afc02f7685915e099c7172bfb0332d65c7d673ce3ad2ad0ad4e82 WatchSource:0}: Error finding container 9000b1f34e6afc02f7685915e099c7172bfb0332d65c7d673ce3ad2ad0ad4e82: Status 404 returned error can't find the container with id 9000b1f34e6afc02f7685915e099c7172bfb0332d65c7d673ce3ad2ad0ad4e82 May 27 21:10:29.539841 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.539807 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ts5d" event={"ID":"eb39e458-d2d6-4bb3-bf78-ef0e06839905","Type":"ContainerStarted","Data":"210dc2ca4567f73b145ffc3d2811805b01aac935b1084d140a81554860c4b4c3"} May 27 21:10:29.540315 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.539849 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ts5d" event={"ID":"eb39e458-d2d6-4bb3-bf78-ef0e06839905","Type":"ContainerStarted","Data":"75d9312fddc801de1df8f8277c2767c6099a827fd89a31ac206df30dc4d04c21"} May 27 21:10:29.541108 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.541085 2566 generic.go:358] "Generic (PLEG): container finished" podID="61d80059-54de-4c6a-950b-dec84198de18" containerID="f9945a24c3b2d4ae88082b642916a6264ce12dad4d5ee55ccdf109eda8be04e7" exitCode=0 May 27 21:10:29.541191 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.541170 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerDied","Data":"f9945a24c3b2d4ae88082b642916a6264ce12dad4d5ee55ccdf109eda8be04e7"} May 27 21:10:29.541261 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.541203 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"9000b1f34e6afc02f7685915e099c7172bfb0332d65c7d673ce3ad2ad0ad4e82"} May 27 21:10:29.558839 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.558778 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2ts5d" podStartSLOduration=253.664082378 podStartE2EDuration="4m14.558762887s" podCreationTimestamp="2026-05-27 21:06:15 +0000 UTC" firstStartedPulling="2026-05-27 21:10:27.747683425 +0000 UTC m=+252.598132460" lastFinishedPulling="2026-05-27 21:10:28.642363919 +0000 UTC m=+253.492812969" observedRunningTime="2026-05-27 21:10:29.557640602 +0000 UTC m=+254.408089661" watchObservedRunningTime="2026-05-27 21:10:29.558762887 +0000 UTC m=+254.409211944" May 27 21:10:29.699045 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:29.699008 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="206e293f-088d-49b0-9f4d-d32e4ecb3720" path="/var/lib/kubelet/pods/206e293f-088d-49b0-9f4d-d32e4ecb3720/volumes" May 27 21:10:30.549724 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.549683 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"805ede4e3c3f2e789bc0a26de639d15cfdd3f6a606ef3a8e523e27f61b263588"} May 27 21:10:30.549724 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.549729 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"8c9fd9c7c819d718f0be044cc4e24ee0dc8040bad435dcbff355a16f9d0c9e90"} May 27 21:10:30.550170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.549743 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"de019e4b4496a479ce2ce4d9fc27a42d6bf65d2ff59461021a9015b6dbadeb3f"} May 27 21:10:30.550170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.549754 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"b6d37bf3761934f05d9d81b11cffde132a5a3e079e589c686f80887f76fe7d08"} May 27 21:10:30.550170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.549762 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"9aae624ee9ad70f6d4639778aefbb81adf8460076fad66dc42292f792261ab06"} May 27 21:10:30.550170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.549770 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61d80059-54de-4c6a-950b-dec84198de18","Type":"ContainerStarted","Data":"3ab7300f9d1b80c7e9ee5f2011aa2826e9acbd6f64cd09bb7e6a6d98cdbac91b"} May 27 21:10:30.587050 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:30.586995 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.58698008 podStartE2EDuration="2.58698008s" podCreationTimestamp="2026-05-27 21:10:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:10:30.584956176 +0000 UTC m=+255.435405235" watchObservedRunningTime="2026-05-27 21:10:30.58698008 +0000 UTC m=+255.437429136" May 27 21:10:33.919636 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:10:33.919595 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:11:15.591397 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:11:15.591367 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:11:15.592398 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:11:15.592338 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:11:15.595793 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:11:15.595781 2566 kubelet.go:1628] "Image garbage collection succeeded" May 27 21:11:28.919647 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:11:28.919597 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:11:28.935253 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:11:28.935225 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:11:29.731662 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:11:29.731625 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:12:16.976944 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:16.976848 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx"] May 27 21:12:16.979960 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:16.979940 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:16.982666 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:16.982644 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 21:12:16.983601 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:16.983583 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xpfqb\"" May 27 21:12:16.983678 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:16.983583 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 21:12:16.990168 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:16.990146 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx"] May 27 21:12:17.031998 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.031963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjgc\" (UniqueName: \"kubernetes.io/projected/1d929df0-d5a3-4618-b754-48c4604fa61f-kube-api-access-xqjgc\") pod \"openshift-lws-operator-bfc7f696d-kbjqx\" (UID: \"1d929df0-d5a3-4618-b754-48c4604fa61f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.032173 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.032065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d929df0-d5a3-4618-b754-48c4604fa61f-tmp\") pod \"openshift-lws-operator-bfc7f696d-kbjqx\" (UID: \"1d929df0-d5a3-4618-b754-48c4604fa61f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.132619 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.132577 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d929df0-d5a3-4618-b754-48c4604fa61f-tmp\") pod \"openshift-lws-operator-bfc7f696d-kbjqx\" (UID: \"1d929df0-d5a3-4618-b754-48c4604fa61f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.132817 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.132645 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjgc\" (UniqueName: \"kubernetes.io/projected/1d929df0-d5a3-4618-b754-48c4604fa61f-kube-api-access-xqjgc\") pod \"openshift-lws-operator-bfc7f696d-kbjqx\" (UID: \"1d929df0-d5a3-4618-b754-48c4604fa61f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.133019 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.132996 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d929df0-d5a3-4618-b754-48c4604fa61f-tmp\") pod \"openshift-lws-operator-bfc7f696d-kbjqx\" (UID: \"1d929df0-d5a3-4618-b754-48c4604fa61f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.153196 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.153169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjgc\" (UniqueName: \"kubernetes.io/projected/1d929df0-d5a3-4618-b754-48c4604fa61f-kube-api-access-xqjgc\") pod \"openshift-lws-operator-bfc7f696d-kbjqx\" (UID: \"1d929df0-d5a3-4618-b754-48c4604fa61f\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.306235 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.306195 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" May 27 21:12:17.447130 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.447104 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx"] May 27 21:12:17.449642 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:12:17.449614 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d929df0_d5a3_4618_b754_48c4604fa61f.slice/crio-f2b1ded9a951071d12995e70c7f2cb57e2b78372c43ba618ccfebf1d6b9d2e12 WatchSource:0}: Error finding container f2b1ded9a951071d12995e70c7f2cb57e2b78372c43ba618ccfebf1d6b9d2e12: Status 404 returned error can't find the container with id f2b1ded9a951071d12995e70c7f2cb57e2b78372c43ba618ccfebf1d6b9d2e12 May 27 21:12:17.451121 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.451103 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:12:17.852885 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:17.852849 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" event={"ID":"1d929df0-d5a3-4618-b754-48c4604fa61f","Type":"ContainerStarted","Data":"f2b1ded9a951071d12995e70c7f2cb57e2b78372c43ba618ccfebf1d6b9d2e12"} May 27 21:12:20.864182 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:20.864142 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" event={"ID":"1d929df0-d5a3-4618-b754-48c4604fa61f","Type":"ContainerStarted","Data":"b72395b538634040b13f89acc4eac207c6de3fe27367fcbfd8674bc71ad5f9a5"} May 27 21:12:20.882013 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:20.881951 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-kbjqx" podStartSLOduration=2.434039154 podStartE2EDuration="4.88191413s" podCreationTimestamp="2026-05-27 21:12:16 +0000 UTC" firstStartedPulling="2026-05-27 21:12:17.45122392 +0000 UTC m=+362.301672955" lastFinishedPulling="2026-05-27 21:12:19.899098885 +0000 UTC m=+364.749547931" observedRunningTime="2026-05-27 21:12:20.880539338 +0000 UTC m=+365.730988392" watchObservedRunningTime="2026-05-27 21:12:20.88191413 +0000 UTC m=+365.732363210" May 27 21:12:40.406522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.406490 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp"] May 27 21:12:40.409674 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.409658 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.412837 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.412812 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 21:12:40.412994 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.412851 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 21:12:40.412994 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.412911 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 21:12:40.413501 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.413486 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xq28h\"" May 27 21:12:40.414064 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.414049 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 21:12:40.426777 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.426750 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp"] May 27 21:12:40.526392 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.526355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/620ffd7a-5583-42a9-9936-13fa3f5655ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.526584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.526404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvvmg\" (UniqueName: \"kubernetes.io/projected/620ffd7a-5583-42a9-9936-13fa3f5655ca-kube-api-access-tvvmg\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.526584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.526468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/620ffd7a-5583-42a9-9936-13fa3f5655ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.627550 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.627516 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/620ffd7a-5583-42a9-9936-13fa3f5655ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.627731 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.627567 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvvmg\" (UniqueName: \"kubernetes.io/projected/620ffd7a-5583-42a9-9936-13fa3f5655ca-kube-api-access-tvvmg\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.627731 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.627691 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/620ffd7a-5583-42a9-9936-13fa3f5655ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.630012 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.629982 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/620ffd7a-5583-42a9-9936-13fa3f5655ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.630156 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.630032 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/620ffd7a-5583-42a9-9936-13fa3f5655ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.636879 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.636853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvvmg\" (UniqueName: \"kubernetes.io/projected/620ffd7a-5583-42a9-9936-13fa3f5655ca-kube-api-access-tvvmg\") pod \"opendatahub-operator-controller-manager-6678cd66dc-4gkvp\" (UID: \"620ffd7a-5583-42a9-9936-13fa3f5655ca\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.719728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.719643 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:40.848723 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.848667 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp"] May 27 21:12:40.851731 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:12:40.851705 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620ffd7a_5583_42a9_9936_13fa3f5655ca.slice/crio-012cd3d472eb0f0bf9fcea40356b8ab1cc7d43393a69f5b728e6d8ffb1f9592a WatchSource:0}: Error finding container 012cd3d472eb0f0bf9fcea40356b8ab1cc7d43393a69f5b728e6d8ffb1f9592a: Status 404 returned error can't find the container with id 012cd3d472eb0f0bf9fcea40356b8ab1cc7d43393a69f5b728e6d8ffb1f9592a May 27 21:12:40.926348 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:40.926309 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" event={"ID":"620ffd7a-5583-42a9-9936-13fa3f5655ca","Type":"ContainerStarted","Data":"012cd3d472eb0f0bf9fcea40356b8ab1cc7d43393a69f5b728e6d8ffb1f9592a"} May 27 21:12:41.980911 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.980869 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb"] May 27 21:12:41.984816 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.984612 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:41.988696 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.988450 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 21:12:41.988696 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.988452 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fx9rw\"" May 27 21:12:41.988696 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.988450 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 21:12:41.988696 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.988617 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 21:12:41.993803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:41.993769 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb"] May 27 21:12:42.041790 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.041731 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp8vb\" (UniqueName: \"kubernetes.io/projected/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-kube-api-access-dp8vb\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.042083 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.041911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-manager-config\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.042083 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.042003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-cert\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.042083 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.042049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-metrics-cert\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.143263 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.143089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-manager-config\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.143263 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.143163 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-cert\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.143263 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.143200 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-metrics-cert\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.143263 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.143250 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dp8vb\" (UniqueName: \"kubernetes.io/projected/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-kube-api-access-dp8vb\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.143942 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.143897 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-manager-config\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.146509 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.146480 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-cert\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.147588 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.147563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-metrics-cert\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.153028 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.153003 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp8vb\" (UniqueName: \"kubernetes.io/projected/91adf13e-a2c2-43c7-b9c3-f62b5d30a59d-kube-api-access-dp8vb\") pod \"lws-controller-manager-dddbcdc66-qlxwb\" (UID: \"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:42.298801 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:42.298763 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:43.488153 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:43.488119 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb"] May 27 21:12:43.491708 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:12:43.491675 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91adf13e_a2c2_43c7_b9c3_f62b5d30a59d.slice/crio-1af9bace6eb5fa2812d2c80a0c0897b3b669f43d7d073472da46396a7f150580 WatchSource:0}: Error finding container 1af9bace6eb5fa2812d2c80a0c0897b3b669f43d7d073472da46396a7f150580: Status 404 returned error can't find the container with id 1af9bace6eb5fa2812d2c80a0c0897b3b669f43d7d073472da46396a7f150580 May 27 21:12:43.937170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:43.937135 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" event={"ID":"620ffd7a-5583-42a9-9936-13fa3f5655ca","Type":"ContainerStarted","Data":"b08059d5130a9005c4d6198e79c90cf0fdf7a7c87d9775c17eb9a2115c2bc8d8"} May 27 21:12:43.937374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:43.937306 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:43.938269 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:43.938241 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" event={"ID":"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d","Type":"ContainerStarted","Data":"1af9bace6eb5fa2812d2c80a0c0897b3b669f43d7d073472da46396a7f150580"} May 27 21:12:43.967396 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:43.967342 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" podStartSLOduration=1.416479905 podStartE2EDuration="3.967322507s" podCreationTimestamp="2026-05-27 21:12:40 +0000 UTC" firstStartedPulling="2026-05-27 21:12:40.854021319 +0000 UTC m=+385.704470354" lastFinishedPulling="2026-05-27 21:12:43.404863918 +0000 UTC m=+388.255312956" observedRunningTime="2026-05-27 21:12:43.966206424 +0000 UTC m=+388.816655517" watchObservedRunningTime="2026-05-27 21:12:43.967322507 +0000 UTC m=+388.817771563" May 27 21:12:45.950808 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:45.950769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" event={"ID":"91adf13e-a2c2-43c7-b9c3-f62b5d30a59d","Type":"ContainerStarted","Data":"5655a2bbc7032c5e43e02460769e7e3ec96667789d6a59be243d117e5e10730b"} May 27 21:12:45.951237 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:45.950942 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:12:45.970764 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:45.970711 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" podStartSLOduration=3.049628159 podStartE2EDuration="4.970695162s" podCreationTimestamp="2026-05-27 21:12:41 +0000 UTC" firstStartedPulling="2026-05-27 21:12:43.494437093 +0000 UTC m=+388.344886132" lastFinishedPulling="2026-05-27 21:12:45.415504098 +0000 UTC m=+390.265953135" observedRunningTime="2026-05-27 21:12:45.969676389 +0000 UTC m=+390.820125449" watchObservedRunningTime="2026-05-27 21:12:45.970695162 +0000 UTC m=+390.821144219" May 27 21:12:54.949805 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:54.949774 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-4gkvp" May 27 21:12:56.956988 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:12:56.956958 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-qlxwb" May 27 21:13:29.578219 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.578182 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8"] May 27 21:13:29.584133 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.584108 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.589470 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.589429 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 21:13:29.589613 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.589519 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mt7tp\"" May 27 21:13:29.604175 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.604144 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8"] May 27 21:13:29.647037 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.646988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647220 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647220 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647220 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647220 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647220 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647388 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647388 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647263 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.647388 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.647291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q69v\" (UniqueName: \"kubernetes.io/projected/7d2f1069-d48a-4e33-8caf-73007c7c7f39-kube-api-access-9q69v\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748352 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748392 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748418 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9q69v\" (UniqueName: \"kubernetes.io/projected/7d2f1069-d48a-4e33-8caf-73007c7c7f39-kube-api-access-9q69v\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748447 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748477 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748507 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748542 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748575 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.748623 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.749004 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.749004 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.748875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.749109 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.749031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.749164 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.749128 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.749263 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.749245 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.750731 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.750710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.751114 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.751092 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.771532 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.771503 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2f1069-d48a-4e33-8caf-73007c7c7f39-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.773013 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.772989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q69v\" (UniqueName: \"kubernetes.io/projected/7d2f1069-d48a-4e33-8caf-73007c7c7f39-kube-api-access-9q69v\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8r8cl8\" (UID: \"7d2f1069-d48a-4e33-8caf-73007c7c7f39\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:29.894723 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:29.894620 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:30.052265 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:30.052229 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8"] May 27 21:13:30.055978 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:13:30.055950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2f1069_d48a_4e33_8caf_73007c7c7f39.slice/crio-d48ae611a949ca606fd7fa1e55b68ee7c7c703fbf5aa56d8ee1c633e124b81b0 WatchSource:0}: Error finding container d48ae611a949ca606fd7fa1e55b68ee7c7c703fbf5aa56d8ee1c633e124b81b0: Status 404 returned error can't find the container with id d48ae611a949ca606fd7fa1e55b68ee7c7c703fbf5aa56d8ee1c633e124b81b0 May 27 21:13:30.098003 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:30.097966 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" event={"ID":"7d2f1069-d48a-4e33-8caf-73007c7c7f39","Type":"ContainerStarted","Data":"d48ae611a949ca606fd7fa1e55b68ee7c7c703fbf5aa56d8ee1c633e124b81b0"} May 27 21:13:32.730185 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:32.730148 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 21:13:32.730462 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:32.730230 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 21:13:32.730462 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:32.730261 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 21:13:33.110699 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:33.110659 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" event={"ID":"7d2f1069-d48a-4e33-8caf-73007c7c7f39","Type":"ContainerStarted","Data":"b30ce85124a36a27c5be7d6968cc63fec1795de93b6af7f646dcfdfa7d32254a"} May 27 21:13:33.136875 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:33.136822 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" podStartSLOduration=1.464826141 podStartE2EDuration="4.136806294s" podCreationTimestamp="2026-05-27 21:13:29 +0000 UTC" firstStartedPulling="2026-05-27 21:13:30.057846468 +0000 UTC m=+434.908295506" lastFinishedPulling="2026-05-27 21:13:32.72982661 +0000 UTC m=+437.580275659" observedRunningTime="2026-05-27 21:13:33.135413476 +0000 UTC m=+437.985862545" watchObservedRunningTime="2026-05-27 21:13:33.136806294 +0000 UTC m=+437.987255351" May 27 21:13:33.894977 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:33.894903 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:33.900161 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:33.900133 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:34.113866 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:34.113827 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:34.115036 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:34.115020 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8r8cl8" May 27 21:13:58.845040 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.845001 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrdtb"] May 27 21:13:58.847188 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.847169 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:13:58.851249 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.851220 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:13:58.851249 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.851225 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-s7jn4\"" May 27 21:13:58.851821 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.851806 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:13:58.859547 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.859516 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrdtb"] May 27 21:13:58.908291 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:58.908252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wrcd\" (UniqueName: \"kubernetes.io/projected/3809051c-da7b-49df-a550-80e4a7349f2a-kube-api-access-6wrcd\") pod \"kuadrant-operator-catalog-lrdtb\" (UID: \"3809051c-da7b-49df-a550-80e4a7349f2a\") " pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:13:59.009728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:59.009684 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wrcd\" (UniqueName: \"kubernetes.io/projected/3809051c-da7b-49df-a550-80e4a7349f2a-kube-api-access-6wrcd\") pod \"kuadrant-operator-catalog-lrdtb\" (UID: \"3809051c-da7b-49df-a550-80e4a7349f2a\") " pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:13:59.025803 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:59.025774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wrcd\" (UniqueName: \"kubernetes.io/projected/3809051c-da7b-49df-a550-80e4a7349f2a-kube-api-access-6wrcd\") pod \"kuadrant-operator-catalog-lrdtb\" (UID: \"3809051c-da7b-49df-a550-80e4a7349f2a\") " pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:13:59.156520 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:59.156430 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:13:59.290408 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:13:59.290386 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrdtb"] May 27 21:13:59.292378 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:13:59.292343 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3809051c_da7b_49df_a550_80e4a7349f2a.slice/crio-e25680c4cb758cffe0b87e591a942ba4d4f17b640a1085bd9ee03572798bb3b5 WatchSource:0}: Error finding container e25680c4cb758cffe0b87e591a942ba4d4f17b640a1085bd9ee03572798bb3b5: Status 404 returned error can't find the container with id e25680c4cb758cffe0b87e591a942ba4d4f17b640a1085bd9ee03572798bb3b5 May 27 21:14:00.197294 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:00.197261 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" event={"ID":"3809051c-da7b-49df-a550-80e4a7349f2a","Type":"ContainerStarted","Data":"e25680c4cb758cffe0b87e591a942ba4d4f17b640a1085bd9ee03572798bb3b5"} May 27 21:14:02.205575 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:02.205539 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" event={"ID":"3809051c-da7b-49df-a550-80e4a7349f2a","Type":"ContainerStarted","Data":"964166e8843526551ad545daf15a135b0d717a197e9e59c538db340f63e69855"} May 27 21:14:02.222741 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:02.222679 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" podStartSLOduration=1.978012354 podStartE2EDuration="4.222661602s" podCreationTimestamp="2026-05-27 21:13:58 +0000 UTC" firstStartedPulling="2026-05-27 21:13:59.294054791 +0000 UTC m=+464.144503826" lastFinishedPulling="2026-05-27 21:14:01.538704034 +0000 UTC m=+466.389153074" observedRunningTime="2026-05-27 21:14:02.222358055 +0000 UTC m=+467.072807114" watchObservedRunningTime="2026-05-27 21:14:02.222661602 +0000 UTC m=+467.073110672" May 27 21:14:09.156958 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:09.156893 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:14:09.157444 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:09.157171 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:14:09.179480 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:09.179448 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:14:09.249471 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:09.249442 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lrdtb" May 27 21:14:26.807695 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.807659 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5d779c8d-4qrp5"] May 27 21:14:26.810959 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.810941 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.814304 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.814284 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rtrd4\"" May 27 21:14:26.815315 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.815293 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 21:14:26.815420 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.815352 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 21:14:26.815420 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.815370 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 21:14:26.815528 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.815461 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 21:14:26.818751 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.818732 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 21:14:26.818831 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.818740 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 21:14:26.818881 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.818855 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 21:14:26.825002 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.824983 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 21:14:26.827237 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.827217 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5d779c8d-4qrp5"] May 27 21:14:26.949751 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.949718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-config\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.949948 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.949760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-serving-cert\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.949948 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.949828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-service-ca\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.949948 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.949870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-oauth-serving-cert\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.949948 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.949916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-oauth-config\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.950092 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.949968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdj77\" (UniqueName: \"kubernetes.io/projected/d9fc71ec-300e-4261-a489-f18f0d085f9a-kube-api-access-pdj77\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:26.950092 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:26.950033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-trusted-ca-bundle\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.050622 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.050581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-oauth-serving-cert\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.050817 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.050644 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-oauth-config\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.050817 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.050766 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdj77\" (UniqueName: \"kubernetes.io/projected/d9fc71ec-300e-4261-a489-f18f0d085f9a-kube-api-access-pdj77\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.050968 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.050835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-trusted-ca-bundle\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.050968 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.050877 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-config\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.050968 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.050951 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-serving-cert\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.051132 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.051012 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-service-ca\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.051545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.051519 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-oauth-serving-cert\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.051653 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.051599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-config\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.051653 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.051598 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-service-ca\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.051801 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.051784 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9fc71ec-300e-4261-a489-f18f0d085f9a-trusted-ca-bundle\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.053108 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.053091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-oauth-config\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.053331 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.053312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9fc71ec-300e-4261-a489-f18f0d085f9a-console-serving-cert\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.067483 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.067428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdj77\" (UniqueName: \"kubernetes.io/projected/d9fc71ec-300e-4261-a489-f18f0d085f9a-kube-api-access-pdj77\") pod \"console-5f5d779c8d-4qrp5\" (UID: \"d9fc71ec-300e-4261-a489-f18f0d085f9a\") " pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.120876 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.120851 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:27.248791 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.248760 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5d779c8d-4qrp5"] May 27 21:14:27.252310 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:14:27.252288 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fc71ec_300e_4261_a489_f18f0d085f9a.slice/crio-a99c4514bb2a32a6b5068da9dd6363c35e6f1699907d0c4d12f2bc54678ca22b WatchSource:0}: Error finding container a99c4514bb2a32a6b5068da9dd6363c35e6f1699907d0c4d12f2bc54678ca22b: Status 404 returned error can't find the container with id a99c4514bb2a32a6b5068da9dd6363c35e6f1699907d0c4d12f2bc54678ca22b May 27 21:14:27.287474 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:27.287445 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5d779c8d-4qrp5" event={"ID":"d9fc71ec-300e-4261-a489-f18f0d085f9a","Type":"ContainerStarted","Data":"a99c4514bb2a32a6b5068da9dd6363c35e6f1699907d0c4d12f2bc54678ca22b"} May 27 21:14:28.291563 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:28.291530 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5d779c8d-4qrp5" event={"ID":"d9fc71ec-300e-4261-a489-f18f0d085f9a","Type":"ContainerStarted","Data":"b9d3db47d3c847502bc0988881098adcee6eac0c77cda8694b19e7d9f274567b"} May 27 21:14:28.312392 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:28.312320 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f5d779c8d-4qrp5" podStartSLOduration=2.312302401 podStartE2EDuration="2.312302401s" podCreationTimestamp="2026-05-27 21:14:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:14:28.311938118 +0000 UTC m=+493.162387176" watchObservedRunningTime="2026-05-27 21:14:28.312302401 +0000 UTC m=+493.162751461" May 27 21:14:29.373411 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.373378 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f"] May 27 21:14:29.376982 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.376958 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:29.380155 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.379798 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-v47vd\"" May 27 21:14:29.380155 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.380039 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 27 21:14:29.388806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.388783 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f"] May 27 21:14:29.478633 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.478596 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm4wr\" (UniqueName: \"kubernetes.io/projected/d7bc7b24-5b30-4a06-a6b7-c434d897f2ae-kube-api-access-bm4wr\") pod \"dns-operator-controller-manager-648d5c98bc-q489f\" (UID: \"d7bc7b24-5b30-4a06-a6b7-c434d897f2ae\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:29.579934 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.579894 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm4wr\" (UniqueName: \"kubernetes.io/projected/d7bc7b24-5b30-4a06-a6b7-c434d897f2ae-kube-api-access-bm4wr\") pod \"dns-operator-controller-manager-648d5c98bc-q489f\" (UID: \"d7bc7b24-5b30-4a06-a6b7-c434d897f2ae\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:29.595123 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.595092 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm4wr\" (UniqueName: \"kubernetes.io/projected/d7bc7b24-5b30-4a06-a6b7-c434d897f2ae-kube-api-access-bm4wr\") pod \"dns-operator-controller-manager-648d5c98bc-q489f\" (UID: \"d7bc7b24-5b30-4a06-a6b7-c434d897f2ae\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:29.691251 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.691166 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:29.831155 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:29.831085 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f"] May 27 21:14:29.833828 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:14:29.833792 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bc7b24_5b30_4a06_a6b7_c434d897f2ae.slice/crio-d58f502563efdbc84b576befbc01ad32a9677a4a501d8d706a19a4dc8549a960 WatchSource:0}: Error finding container d58f502563efdbc84b576befbc01ad32a9677a4a501d8d706a19a4dc8549a960: Status 404 returned error can't find the container with id d58f502563efdbc84b576befbc01ad32a9677a4a501d8d706a19a4dc8549a960 May 27 21:14:30.298827 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:30.298785 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" event={"ID":"d7bc7b24-5b30-4a06-a6b7-c434d897f2ae","Type":"ContainerStarted","Data":"d58f502563efdbc84b576befbc01ad32a9677a4a501d8d706a19a4dc8549a960"} May 27 21:14:33.309551 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:33.309511 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" event={"ID":"d7bc7b24-5b30-4a06-a6b7-c434d897f2ae","Type":"ContainerStarted","Data":"bca14ddb4c0d6b24f921cf2fe8b12e4587138b27fbbe9e2515a9d63c9080d6c0"} May 27 21:14:33.310002 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:33.309639 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:33.339377 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:33.339313 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" podStartSLOduration=1.8365513519999999 podStartE2EDuration="4.339299887s" podCreationTimestamp="2026-05-27 21:14:29 +0000 UTC" firstStartedPulling="2026-05-27 21:14:29.835753217 +0000 UTC m=+494.686202255" lastFinishedPulling="2026-05-27 21:14:32.338501741 +0000 UTC m=+497.188950790" observedRunningTime="2026-05-27 21:14:33.338869149 +0000 UTC m=+498.189318199" watchObservedRunningTime="2026-05-27 21:14:33.339299887 +0000 UTC m=+498.189748938" May 27 21:14:37.121407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.121375 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:37.121407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.121411 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:37.126237 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.126215 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:37.326689 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.326663 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5d779c8d-4qrp5" May 27 21:14:37.712130 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.712098 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975"] May 27 21:14:37.715462 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.715445 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:37.718492 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.718472 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hpvj2\"" May 27 21:14:37.726960 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.726939 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975"] May 27 21:14:37.852747 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.852717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jdw2\" (UniqueName: \"kubernetes.io/projected/9b2b3449-3f57-4f9a-b816-2d4b26c5520d-kube-api-access-9jdw2\") pod \"limitador-operator-controller-manager-85c4996f8c-b6975\" (UID: \"9b2b3449-3f57-4f9a-b816-2d4b26c5520d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:37.953888 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.953858 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jdw2\" (UniqueName: \"kubernetes.io/projected/9b2b3449-3f57-4f9a-b816-2d4b26c5520d-kube-api-access-9jdw2\") pod \"limitador-operator-controller-manager-85c4996f8c-b6975\" (UID: \"9b2b3449-3f57-4f9a-b816-2d4b26c5520d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:37.963352 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:37.963272 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jdw2\" (UniqueName: \"kubernetes.io/projected/9b2b3449-3f57-4f9a-b816-2d4b26c5520d-kube-api-access-9jdw2\") pod \"limitador-operator-controller-manager-85c4996f8c-b6975\" (UID: \"9b2b3449-3f57-4f9a-b816-2d4b26c5520d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:38.025190 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:38.025156 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:38.160743 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:38.160706 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975"] May 27 21:14:38.163679 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:14:38.163650 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2b3449_3f57_4f9a_b816_2d4b26c5520d.slice/crio-e48166fea156af8baf778a301bbdfaf451f30c7280c7c976534e7163ec93af13 WatchSource:0}: Error finding container e48166fea156af8baf778a301bbdfaf451f30c7280c7c976534e7163ec93af13: Status 404 returned error can't find the container with id e48166fea156af8baf778a301bbdfaf451f30c7280c7c976534e7163ec93af13 May 27 21:14:38.327454 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:38.327413 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" event={"ID":"9b2b3449-3f57-4f9a-b816-2d4b26c5520d","Type":"ContainerStarted","Data":"e48166fea156af8baf778a301bbdfaf451f30c7280c7c976534e7163ec93af13"} May 27 21:14:40.338382 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:40.338298 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" event={"ID":"9b2b3449-3f57-4f9a-b816-2d4b26c5520d","Type":"ContainerStarted","Data":"b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03"} May 27 21:14:40.338716 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:40.338387 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:40.375307 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:40.375259 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" podStartSLOduration=1.485204839 podStartE2EDuration="3.375243587s" podCreationTimestamp="2026-05-27 21:14:37 +0000 UTC" firstStartedPulling="2026-05-27 21:14:38.165602896 +0000 UTC m=+503.016051935" lastFinishedPulling="2026-05-27 21:14:40.055641648 +0000 UTC m=+504.906090683" observedRunningTime="2026-05-27 21:14:40.374750872 +0000 UTC m=+505.225199929" watchObservedRunningTime="2026-05-27 21:14:40.375243587 +0000 UTC m=+505.225692644" May 27 21:14:41.765183 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.765150 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-2jr6f"] May 27 21:14:41.768569 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.768551 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:14:41.771561 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.771540 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-w22wc\"" May 27 21:14:41.779540 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.779516 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-2jr6f"] May 27 21:14:41.889332 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.889296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszhs\" (UniqueName: \"kubernetes.io/projected/43944bb2-4546-4ea3-9386-bbefa6412f64-kube-api-access-bszhs\") pod \"authorino-operator-657f44b778-2jr6f\" (UID: \"43944bb2-4546-4ea3-9386-bbefa6412f64\") " pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:14:41.990380 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.990334 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bszhs\" (UniqueName: \"kubernetes.io/projected/43944bb2-4546-4ea3-9386-bbefa6412f64-kube-api-access-bszhs\") pod \"authorino-operator-657f44b778-2jr6f\" (UID: \"43944bb2-4546-4ea3-9386-bbefa6412f64\") " pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:14:41.999776 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:41.999742 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszhs\" (UniqueName: \"kubernetes.io/projected/43944bb2-4546-4ea3-9386-bbefa6412f64-kube-api-access-bszhs\") pod \"authorino-operator-657f44b778-2jr6f\" (UID: \"43944bb2-4546-4ea3-9386-bbefa6412f64\") " pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:14:42.078810 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:42.078777 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:14:42.211299 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:42.211276 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-2jr6f"] May 27 21:14:42.212949 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:14:42.212902 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43944bb2_4546_4ea3_9386_bbefa6412f64.slice/crio-9c6a26987bf4e1399fe906ea08d77b745a54fe2cf3a9e5ec6a1e30339bf238d9 WatchSource:0}: Error finding container 9c6a26987bf4e1399fe906ea08d77b745a54fe2cf3a9e5ec6a1e30339bf238d9: Status 404 returned error can't find the container with id 9c6a26987bf4e1399fe906ea08d77b745a54fe2cf3a9e5ec6a1e30339bf238d9 May 27 21:14:42.346914 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:42.346844 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" event={"ID":"43944bb2-4546-4ea3-9386-bbefa6412f64","Type":"ContainerStarted","Data":"9c6a26987bf4e1399fe906ea08d77b745a54fe2cf3a9e5ec6a1e30339bf238d9"} May 27 21:14:44.315238 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:44.315205 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-q489f" May 27 21:14:45.358705 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:45.358672 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" event={"ID":"43944bb2-4546-4ea3-9386-bbefa6412f64","Type":"ContainerStarted","Data":"bbe7c20c2aa2fdaa2b00528e3e13a7ebd88da5ccc9ff4855ac884306d6d92c78"} May 27 21:14:45.359166 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:45.358780 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:14:45.389546 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:45.389503 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" podStartSLOduration=2.159192325 podStartE2EDuration="4.389490969s" podCreationTimestamp="2026-05-27 21:14:41 +0000 UTC" firstStartedPulling="2026-05-27 21:14:42.214890352 +0000 UTC m=+507.065339388" lastFinishedPulling="2026-05-27 21:14:44.445188994 +0000 UTC m=+509.295638032" observedRunningTime="2026-05-27 21:14:45.388582941 +0000 UTC m=+510.239031998" watchObservedRunningTime="2026-05-27 21:14:45.389490969 +0000 UTC m=+510.239940025" May 27 21:14:51.344604 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:51.344571 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:54.289002 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.288966 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975"] May 27 21:14:54.289486 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.289187 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" containerName="manager" containerID="cri-o://b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03" gracePeriod=2 May 27 21:14:54.296684 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.296650 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975"] May 27 21:14:54.356100 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.356068 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw"] May 27 21:14:54.356434 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.356420 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" containerName="manager" May 27 21:14:54.356434 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.356435 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" containerName="manager" May 27 21:14:54.356560 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.356506 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" containerName="manager" May 27 21:14:54.359440 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.359417 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:14:54.396025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.395986 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2cr\" (UniqueName: \"kubernetes.io/projected/05d153aa-53b1-486e-b2ca-535a4f978ada-kube-api-access-8b2cr\") pod \"limitador-operator-controller-manager-85c4996f8c-7lgqw\" (UID: \"05d153aa-53b1-486e-b2ca-535a4f978ada\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:14:54.399983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.399955 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw"] May 27 21:14:54.433517 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.433444 2566 status_manager.go:895] "Failed to get status for pod" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" err="pods \"limitador-operator-controller-manager-85c4996f8c-b6975\" is forbidden: User \"system:node:ip-10-0-136-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-186.ec2.internal' and this object" May 27 21:14:54.497604 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.497569 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2cr\" (UniqueName: \"kubernetes.io/projected/05d153aa-53b1-486e-b2ca-535a4f978ada-kube-api-access-8b2cr\") pod \"limitador-operator-controller-manager-85c4996f8c-7lgqw\" (UID: \"05d153aa-53b1-486e-b2ca-535a4f978ada\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:14:54.509093 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.509066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2cr\" (UniqueName: \"kubernetes.io/projected/05d153aa-53b1-486e-b2ca-535a4f978ada-kube-api-access-8b2cr\") pod \"limitador-operator-controller-manager-85c4996f8c-7lgqw\" (UID: \"05d153aa-53b1-486e-b2ca-535a4f978ada\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:14:54.530003 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.529979 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:54.532641 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.532614 2566 status_manager.go:895] "Failed to get status for pod" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" err="pods \"limitador-operator-controller-manager-85c4996f8c-b6975\" is forbidden: User \"system:node:ip-10-0-136-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-186.ec2.internal' and this object" May 27 21:14:54.598556 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.598473 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jdw2\" (UniqueName: \"kubernetes.io/projected/9b2b3449-3f57-4f9a-b816-2d4b26c5520d-kube-api-access-9jdw2\") pod \"9b2b3449-3f57-4f9a-b816-2d4b26c5520d\" (UID: \"9b2b3449-3f57-4f9a-b816-2d4b26c5520d\") " May 27 21:14:54.600602 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.600576 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2b3449-3f57-4f9a-b816-2d4b26c5520d-kube-api-access-9jdw2" (OuterVolumeSpecName: "kube-api-access-9jdw2") pod "9b2b3449-3f57-4f9a-b816-2d4b26c5520d" (UID: "9b2b3449-3f57-4f9a-b816-2d4b26c5520d"). InnerVolumeSpecName "kube-api-access-9jdw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:14:54.670881 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.670843 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:14:54.699586 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.699554 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jdw2\" (UniqueName: \"kubernetes.io/projected/9b2b3449-3f57-4f9a-b816-2d4b26c5520d-kube-api-access-9jdw2\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:14:54.818280 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:54.818257 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw"] May 27 21:14:54.820171 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:14:54.820144 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d153aa_53b1_486e_b2ca_535a4f978ada.slice/crio-4a2500e447d0f9d1e5f6c5288ae5f6cd675c12e714ddbfbb4766d8fe070ea1ec WatchSource:0}: Error finding container 4a2500e447d0f9d1e5f6c5288ae5f6cd675c12e714ddbfbb4766d8fe070ea1ec: Status 404 returned error can't find the container with id 4a2500e447d0f9d1e5f6c5288ae5f6cd675c12e714ddbfbb4766d8fe070ea1ec May 27 21:14:55.392257 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.392224 2566 generic.go:358] "Generic (PLEG): container finished" podID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" containerID="b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03" exitCode=0 May 27 21:14:55.392697 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.392287 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" May 27 21:14:55.392697 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.392332 2566 scope.go:117] "RemoveContainer" containerID="b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03" May 27 21:14:55.393852 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.393828 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" event={"ID":"05d153aa-53b1-486e-b2ca-535a4f978ada","Type":"ContainerStarted","Data":"a4b0d8ff6df7d5fed4be96945a5c76bd9de0cab2cab726c821a9612dd8385ff3"} May 27 21:14:55.393965 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.393860 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" event={"ID":"05d153aa-53b1-486e-b2ca-535a4f978ada","Type":"ContainerStarted","Data":"4a2500e447d0f9d1e5f6c5288ae5f6cd675c12e714ddbfbb4766d8fe070ea1ec"} May 27 21:14:55.394018 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.393987 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:14:55.395304 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.395274 2566 status_manager.go:895] "Failed to get status for pod" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" err="pods \"limitador-operator-controller-manager-85c4996f8c-b6975\" is forbidden: User \"system:node:ip-10-0-136-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-186.ec2.internal' and this object" May 27 21:14:55.400460 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.400443 2566 scope.go:117] "RemoveContainer" containerID="b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03" May 27 21:14:55.400706 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:14:55.400685 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03\": container with ID starting with b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03 not found: ID does not exist" containerID="b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03" May 27 21:14:55.400760 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.400713 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03"} err="failed to get container status \"b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03\": rpc error: code = NotFound desc = could not find container \"b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03\": container with ID starting with b4d4eca389e949d489d779cbf737c779745495b14c007f4a9e3476d9de7c8b03 not found: ID does not exist" May 27 21:14:55.451714 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.451674 2566 status_manager.go:895] "Failed to get status for pod" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" err="pods \"limitador-operator-controller-manager-85c4996f8c-b6975\" is forbidden: User \"system:node:ip-10-0-136-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-186.ec2.internal' and this object" May 27 21:14:55.451981 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.451944 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" podStartSLOduration=1.451916838 podStartE2EDuration="1.451916838s" podCreationTimestamp="2026-05-27 21:14:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:14:55.449155155 +0000 UTC m=+520.299604212" watchObservedRunningTime="2026-05-27 21:14:55.451916838 +0000 UTC m=+520.302365895" May 27 21:14:55.453990 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.453968 2566 status_manager.go:895] "Failed to get status for pod" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" err="pods \"limitador-operator-controller-manager-85c4996f8c-b6975\" is forbidden: User \"system:node:ip-10-0-136-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-186.ec2.internal' and this object" May 27 21:14:55.696542 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.696465 2566 status_manager.go:895] "Failed to get status for pod" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b6975" err="pods \"limitador-operator-controller-manager-85c4996f8c-b6975\" is forbidden: User \"system:node:ip-10-0-136-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-186.ec2.internal' and this object" May 27 21:14:55.697033 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:55.697011 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b2b3449-3f57-4f9a-b816-2d4b26c5520d" path="/var/lib/kubelet/pods/9b2b3449-3f57-4f9a-b816-2d4b26c5520d/volumes" May 27 21:14:56.363951 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:14:56.363892 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-2jr6f" May 27 21:15:06.401110 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:06.401040 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7lgqw" May 27 21:15:31.283748 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.283713 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-c9jn4"] May 27 21:15:31.288699 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.288679 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:15:31.291540 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.291523 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ncq76\"" May 27 21:15:31.296667 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.296646 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-c9jn4"] May 27 21:15:31.411242 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.411205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh2hg\" (UniqueName: \"kubernetes.io/projected/01c935d1-a176-4991-bf91-255ca13b7a8c-kube-api-access-fh2hg\") pod \"authorino-7498df8756-c9jn4\" (UID: \"01c935d1-a176-4991-bf91-255ca13b7a8c\") " pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:15:31.512170 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.512129 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2hg\" (UniqueName: \"kubernetes.io/projected/01c935d1-a176-4991-bf91-255ca13b7a8c-kube-api-access-fh2hg\") pod \"authorino-7498df8756-c9jn4\" (UID: \"01c935d1-a176-4991-bf91-255ca13b7a8c\") " pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:15:31.520654 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.520624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh2hg\" (UniqueName: \"kubernetes.io/projected/01c935d1-a176-4991-bf91-255ca13b7a8c-kube-api-access-fh2hg\") pod \"authorino-7498df8756-c9jn4\" (UID: \"01c935d1-a176-4991-bf91-255ca13b7a8c\") " pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:15:31.598500 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.598403 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:15:31.727995 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:31.727973 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-c9jn4"] May 27 21:15:31.730416 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:15:31.730383 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01c935d1_a176_4991_bf91_255ca13b7a8c.slice/crio-0685be6cd6645c756a7eb75b909bafacfe598c19d93236f8ebdf7bb759ae7503 WatchSource:0}: Error finding container 0685be6cd6645c756a7eb75b909bafacfe598c19d93236f8ebdf7bb759ae7503: Status 404 returned error can't find the container with id 0685be6cd6645c756a7eb75b909bafacfe598c19d93236f8ebdf7bb759ae7503 May 27 21:15:32.522115 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:32.522025 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c9jn4" event={"ID":"01c935d1-a176-4991-bf91-255ca13b7a8c","Type":"ContainerStarted","Data":"0685be6cd6645c756a7eb75b909bafacfe598c19d93236f8ebdf7bb759ae7503"} May 27 21:15:35.536849 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:35.536812 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c9jn4" event={"ID":"01c935d1-a176-4991-bf91-255ca13b7a8c","Type":"ContainerStarted","Data":"555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d"} May 27 21:15:35.564993 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:15:35.564937 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-c9jn4" podStartSLOduration=1.6427682620000001 podStartE2EDuration="4.564905817s" podCreationTimestamp="2026-05-27 21:15:31 +0000 UTC" firstStartedPulling="2026-05-27 21:15:31.731611566 +0000 UTC m=+556.582060600" lastFinishedPulling="2026-05-27 21:15:34.653749108 +0000 UTC m=+559.504198155" observedRunningTime="2026-05-27 21:15:35.563303335 +0000 UTC m=+560.413752406" watchObservedRunningTime="2026-05-27 21:15:35.564905817 +0000 UTC m=+560.415354874" May 27 21:16:03.507854 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.507815 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5798968495-knvtx"] May 27 21:16:03.512761 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.512740 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:03.523555 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.523530 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5798968495-knvtx"] May 27 21:16:03.590971 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.590941 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9nz\" (UniqueName: \"kubernetes.io/projected/a58bcfeb-a54e-4539-b288-701f44e8a086-kube-api-access-xx9nz\") pod \"authorino-5798968495-knvtx\" (UID: \"a58bcfeb-a54e-4539-b288-701f44e8a086\") " pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:03.692277 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.692235 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9nz\" (UniqueName: \"kubernetes.io/projected/a58bcfeb-a54e-4539-b288-701f44e8a086-kube-api-access-xx9nz\") pod \"authorino-5798968495-knvtx\" (UID: \"a58bcfeb-a54e-4539-b288-701f44e8a086\") " pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:03.703907 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.703878 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9nz\" (UniqueName: \"kubernetes.io/projected/a58bcfeb-a54e-4539-b288-701f44e8a086-kube-api-access-xx9nz\") pod \"authorino-5798968495-knvtx\" (UID: \"a58bcfeb-a54e-4539-b288-701f44e8a086\") " pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:03.749276 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.749236 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5798968495-knvtx"] May 27 21:16:03.749544 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.749527 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:03.877658 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:03.877625 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5798968495-knvtx"] May 27 21:16:03.880961 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:16:03.880901 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda58bcfeb_a54e_4539_b288_701f44e8a086.slice/crio-546423ef46c44d3cb70d6c770158e3dcbcd93f2a05af70f4a86929fcf3c28b2c WatchSource:0}: Error finding container 546423ef46c44d3cb70d6c770158e3dcbcd93f2a05af70f4a86929fcf3c28b2c: Status 404 returned error can't find the container with id 546423ef46c44d3cb70d6c770158e3dcbcd93f2a05af70f4a86929fcf3c28b2c May 27 21:16:04.637983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:04.637945 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5798968495-knvtx" event={"ID":"a58bcfeb-a54e-4539-b288-701f44e8a086","Type":"ContainerStarted","Data":"584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f"} May 27 21:16:04.637983 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:04.637983 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5798968495-knvtx" event={"ID":"a58bcfeb-a54e-4539-b288-701f44e8a086","Type":"ContainerStarted","Data":"546423ef46c44d3cb70d6c770158e3dcbcd93f2a05af70f4a86929fcf3c28b2c"} May 27 21:16:04.638412 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:04.638060 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5798968495-knvtx" podUID="a58bcfeb-a54e-4539-b288-701f44e8a086" containerName="authorino" containerID="cri-o://584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f" gracePeriod=30 May 27 21:16:04.655965 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:04.655907 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5798968495-knvtx" podStartSLOduration=1.28053471 podStartE2EDuration="1.655894347s" podCreationTimestamp="2026-05-27 21:16:03 +0000 UTC" firstStartedPulling="2026-05-27 21:16:03.882238138 +0000 UTC m=+588.732687174" lastFinishedPulling="2026-05-27 21:16:04.257597761 +0000 UTC m=+589.108046811" observedRunningTime="2026-05-27 21:16:04.655142478 +0000 UTC m=+589.505591537" watchObservedRunningTime="2026-05-27 21:16:04.655894347 +0000 UTC m=+589.506343403" May 27 21:16:04.886051 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:04.886030 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:05.004260 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.004157 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx9nz\" (UniqueName: \"kubernetes.io/projected/a58bcfeb-a54e-4539-b288-701f44e8a086-kube-api-access-xx9nz\") pod \"a58bcfeb-a54e-4539-b288-701f44e8a086\" (UID: \"a58bcfeb-a54e-4539-b288-701f44e8a086\") " May 27 21:16:05.006331 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.006303 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a58bcfeb-a54e-4539-b288-701f44e8a086-kube-api-access-xx9nz" (OuterVolumeSpecName: "kube-api-access-xx9nz") pod "a58bcfeb-a54e-4539-b288-701f44e8a086" (UID: "a58bcfeb-a54e-4539-b288-701f44e8a086"). InnerVolumeSpecName "kube-api-access-xx9nz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:16:05.105268 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.105237 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx9nz\" (UniqueName: \"kubernetes.io/projected/a58bcfeb-a54e-4539-b288-701f44e8a086-kube-api-access-xx9nz\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:16:05.389797 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.389754 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-c9jn4"] May 27 21:16:05.390028 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.389976 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-c9jn4" podUID="01c935d1-a176-4991-bf91-255ca13b7a8c" containerName="authorino" containerID="cri-o://555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d" gracePeriod=30 May 27 21:16:05.622877 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.622855 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:16:05.641694 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.641626 2566 generic.go:358] "Generic (PLEG): container finished" podID="01c935d1-a176-4991-bf91-255ca13b7a8c" containerID="555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d" exitCode=0 May 27 21:16:05.641694 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.641669 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c9jn4" May 27 21:16:05.642095 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.641712 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c9jn4" event={"ID":"01c935d1-a176-4991-bf91-255ca13b7a8c","Type":"ContainerDied","Data":"555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d"} May 27 21:16:05.642095 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.641742 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c9jn4" event={"ID":"01c935d1-a176-4991-bf91-255ca13b7a8c","Type":"ContainerDied","Data":"0685be6cd6645c756a7eb75b909bafacfe598c19d93236f8ebdf7bb759ae7503"} May 27 21:16:05.642095 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.641757 2566 scope.go:117] "RemoveContainer" containerID="555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d" May 27 21:16:05.642907 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.642882 2566 generic.go:358] "Generic (PLEG): container finished" podID="a58bcfeb-a54e-4539-b288-701f44e8a086" containerID="584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f" exitCode=0 May 27 21:16:05.643050 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.642935 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5798968495-knvtx" May 27 21:16:05.643050 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.642949 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5798968495-knvtx" event={"ID":"a58bcfeb-a54e-4539-b288-701f44e8a086","Type":"ContainerDied","Data":"584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f"} May 27 21:16:05.643050 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.642978 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5798968495-knvtx" event={"ID":"a58bcfeb-a54e-4539-b288-701f44e8a086","Type":"ContainerDied","Data":"546423ef46c44d3cb70d6c770158e3dcbcd93f2a05af70f4a86929fcf3c28b2c"} May 27 21:16:05.650615 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.650602 2566 scope.go:117] "RemoveContainer" containerID="555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d" May 27 21:16:05.650895 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:05.650872 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d\": container with ID starting with 555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d not found: ID does not exist" containerID="555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d" May 27 21:16:05.651003 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.650902 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d"} err="failed to get container status \"555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d\": rpc error: code = NotFound desc = could not find container \"555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d\": container with ID starting with 555007ceaa9da1912ef289916925c6656af0d7f3bf01baa02288b46f0c76577d not found: ID does not exist" May 27 21:16:05.651003 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.650935 2566 scope.go:117] "RemoveContainer" containerID="584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f" May 27 21:16:05.658697 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.658679 2566 scope.go:117] "RemoveContainer" containerID="584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f" May 27 21:16:05.658995 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:05.658973 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f\": container with ID starting with 584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f not found: ID does not exist" containerID="584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f" May 27 21:16:05.659051 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.659006 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f"} err="failed to get container status \"584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f\": rpc error: code = NotFound desc = could not find container \"584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f\": container with ID starting with 584e3516fa245405f4864fb89fd1c03fe807725d25d7c9ee943b7b524fd1422f not found: ID does not exist" May 27 21:16:05.667114 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.667092 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5798968495-knvtx"] May 27 21:16:05.670248 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.670230 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5798968495-knvtx"] May 27 21:16:05.696788 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.696766 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a58bcfeb-a54e-4539-b288-701f44e8a086" path="/var/lib/kubelet/pods/a58bcfeb-a54e-4539-b288-701f44e8a086/volumes" May 27 21:16:05.709845 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.709822 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh2hg\" (UniqueName: \"kubernetes.io/projected/01c935d1-a176-4991-bf91-255ca13b7a8c-kube-api-access-fh2hg\") pod \"01c935d1-a176-4991-bf91-255ca13b7a8c\" (UID: \"01c935d1-a176-4991-bf91-255ca13b7a8c\") " May 27 21:16:05.712007 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.711979 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c935d1-a176-4991-bf91-255ca13b7a8c-kube-api-access-fh2hg" (OuterVolumeSpecName: "kube-api-access-fh2hg") pod "01c935d1-a176-4991-bf91-255ca13b7a8c" (UID: "01c935d1-a176-4991-bf91-255ca13b7a8c"). InnerVolumeSpecName "kube-api-access-fh2hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:16:05.810903 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.810870 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh2hg\" (UniqueName: \"kubernetes.io/projected/01c935d1-a176-4991-bf91-255ca13b7a8c-kube-api-access-fh2hg\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:16:05.963636 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.963598 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-c9jn4"] May 27 21:16:05.968300 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:05.968275 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-c9jn4"] May 27 21:16:07.697102 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:07.697071 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c935d1-a176-4991-bf91-255ca13b7a8c" path="/var/lib/kubelet/pods/01c935d1-a176-4991-bf91-255ca13b7a8c/volumes" May 27 21:16:08.610206 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610171 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84c667dd69-68p62"] May 27 21:16:08.610590 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610568 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a58bcfeb-a54e-4539-b288-701f44e8a086" containerName="authorino" May 27 21:16:08.610689 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610591 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58bcfeb-a54e-4539-b288-701f44e8a086" containerName="authorino" May 27 21:16:08.610689 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610616 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c935d1-a176-4991-bf91-255ca13b7a8c" containerName="authorino" May 27 21:16:08.610689 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610624 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c935d1-a176-4991-bf91-255ca13b7a8c" containerName="authorino" May 27 21:16:08.610855 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610720 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c935d1-a176-4991-bf91-255ca13b7a8c" containerName="authorino" May 27 21:16:08.610855 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.610732 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="a58bcfeb-a54e-4539-b288-701f44e8a086" containerName="authorino" May 27 21:16:08.613702 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.613687 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:08.616344 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.616325 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4hw85\"" May 27 21:16:08.616584 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.616567 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" May 27 21:16:08.617264 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.617250 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 21:16:08.626245 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.626225 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c667dd69-68p62"] May 27 21:16:08.733512 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.733479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:08.733892 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.733596 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8slxb\" (UniqueName: \"kubernetes.io/projected/8a4dea6f-dca4-4556-87a8-f7d2a661023a-kube-api-access-8slxb\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:08.797893 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.797856 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6485588796-fttfp"] May 27 21:16:08.801103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.801087 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:08.816708 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.816675 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485588796-fttfp"] May 27 21:16:08.834374 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.834350 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:08.834527 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.834430 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8slxb\" (UniqueName: \"kubernetes.io/projected/8a4dea6f-dca4-4556-87a8-f7d2a661023a-kube-api-access-8slxb\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:08.834614 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:08.834528 2566 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found May 27 21:16:08.834614 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:08.834595 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert podName:8a4dea6f-dca4-4556-87a8-f7d2a661023a nodeName:}" failed. No retries permitted until 2026-05-27 21:16:09.334576096 +0000 UTC m=+594.185025136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert") pod "maas-controller-84c667dd69-68p62" (UID: "8a4dea6f-dca4-4556-87a8-f7d2a661023a") : secret "maas-controller-webhook-cert" not found May 27 21:16:08.851846 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.851821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8slxb\" (UniqueName: \"kubernetes.io/projected/8a4dea6f-dca4-4556-87a8-f7d2a661023a-kube-api-access-8slxb\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:08.935264 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.935190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81577355-9911-4eb4-adab-fa66d4ec50fd-webhook-cert\") pod \"maas-controller-6485588796-fttfp\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:08.935394 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:08.935313 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwf27\" (UniqueName: \"kubernetes.io/projected/81577355-9911-4eb4-adab-fa66d4ec50fd-kube-api-access-dwf27\") pod \"maas-controller-6485588796-fttfp\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:09.036001 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.035962 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwf27\" (UniqueName: \"kubernetes.io/projected/81577355-9911-4eb4-adab-fa66d4ec50fd-kube-api-access-dwf27\") pod \"maas-controller-6485588796-fttfp\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:09.036197 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.036025 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81577355-9911-4eb4-adab-fa66d4ec50fd-webhook-cert\") pod \"maas-controller-6485588796-fttfp\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:09.038346 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.038328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81577355-9911-4eb4-adab-fa66d4ec50fd-webhook-cert\") pod \"maas-controller-6485588796-fttfp\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:09.045362 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.045341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwf27\" (UniqueName: \"kubernetes.io/projected/81577355-9911-4eb4-adab-fa66d4ec50fd-kube-api-access-dwf27\") pod \"maas-controller-6485588796-fttfp\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:09.110502 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.110477 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:09.238648 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.238617 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485588796-fttfp"] May 27 21:16:09.240638 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:16:09.240616 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81577355_9911_4eb4_adab_fa66d4ec50fd.slice/crio-a3ea44e65599140440e7bc304f51361d1a72ef241aa19c664889c37a544cfc3b WatchSource:0}: Error finding container a3ea44e65599140440e7bc304f51361d1a72ef241aa19c664889c37a544cfc3b: Status 404 returned error can't find the container with id a3ea44e65599140440e7bc304f51361d1a72ef241aa19c664889c37a544cfc3b May 27 21:16:09.338857 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.338835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:09.341066 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.341042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert\") pod \"maas-controller-84c667dd69-68p62\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:09.525382 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.525303 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:09.653465 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.653407 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c667dd69-68p62"] May 27 21:16:09.655572 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:16:09.655540 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4dea6f_dca4_4556_87a8_f7d2a661023a.slice/crio-3a96575a4cf4dc72b9a24e40cdf97ab3ae6f126a88f4c1b85c85648dcde12427 WatchSource:0}: Error finding container 3a96575a4cf4dc72b9a24e40cdf97ab3ae6f126a88f4c1b85c85648dcde12427: Status 404 returned error can't find the container with id 3a96575a4cf4dc72b9a24e40cdf97ab3ae6f126a88f4c1b85c85648dcde12427 May 27 21:16:09.658960 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:09.658907 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485588796-fttfp" event={"ID":"81577355-9911-4eb4-adab-fa66d4ec50fd","Type":"ContainerStarted","Data":"a3ea44e65599140440e7bc304f51361d1a72ef241aa19c664889c37a544cfc3b"} May 27 21:16:10.664735 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:10.664691 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c667dd69-68p62" event={"ID":"8a4dea6f-dca4-4556-87a8-f7d2a661023a","Type":"ContainerStarted","Data":"3a96575a4cf4dc72b9a24e40cdf97ab3ae6f126a88f4c1b85c85648dcde12427"} May 27 21:16:12.672563 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:12.672525 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c667dd69-68p62" event={"ID":"8a4dea6f-dca4-4556-87a8-f7d2a661023a","Type":"ContainerStarted","Data":"3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959"} May 27 21:16:12.672563 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:12.672579 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:12.673786 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:12.673764 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485588796-fttfp" event={"ID":"81577355-9911-4eb4-adab-fa66d4ec50fd","Type":"ContainerStarted","Data":"0c409e6dab8a8156c238ab17b692c800a5f1944b616f6df6e13064802d807bb6"} May 27 21:16:12.673912 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:12.673893 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:12.691840 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:12.691795 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-84c667dd69-68p62" podStartSLOduration=2.5314561700000002 podStartE2EDuration="4.691780723s" podCreationTimestamp="2026-05-27 21:16:08 +0000 UTC" firstStartedPulling="2026-05-27 21:16:09.656802226 +0000 UTC m=+594.507251265" lastFinishedPulling="2026-05-27 21:16:11.817126768 +0000 UTC m=+596.667575818" observedRunningTime="2026-05-27 21:16:12.690105893 +0000 UTC m=+597.540554951" watchObservedRunningTime="2026-05-27 21:16:12.691780723 +0000 UTC m=+597.542229780" May 27 21:16:12.710428 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:12.710388 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6485588796-fttfp" podStartSLOduration=2.145210607 podStartE2EDuration="4.710377882s" podCreationTimestamp="2026-05-27 21:16:08 +0000 UTC" firstStartedPulling="2026-05-27 21:16:09.241864477 +0000 UTC m=+594.092313512" lastFinishedPulling="2026-05-27 21:16:11.807031748 +0000 UTC m=+596.657480787" observedRunningTime="2026-05-27 21:16:12.708858685 +0000 UTC m=+597.559307744" watchObservedRunningTime="2026-05-27 21:16:12.710377882 +0000 UTC m=+597.560826992" May 27 21:16:15.617323 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:15.617294 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:16:15.617323 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:15.617305 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:16:23.682592 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:23.682560 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:23.682976 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:23.682724 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:16:23.792394 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:23.792361 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c667dd69-68p62"] May 27 21:16:23.792589 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:23.792568 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-84c667dd69-68p62" podUID="8a4dea6f-dca4-4556-87a8-f7d2a661023a" containerName="manager" containerID="cri-o://3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959" gracePeriod=30 May 27 21:16:24.038607 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.038588 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:24.158005 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.157983 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8slxb\" (UniqueName: \"kubernetes.io/projected/8a4dea6f-dca4-4556-87a8-f7d2a661023a-kube-api-access-8slxb\") pod \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " May 27 21:16:24.158128 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.158069 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert\") pod \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\" (UID: \"8a4dea6f-dca4-4556-87a8-f7d2a661023a\") " May 27 21:16:24.160081 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.160044 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4dea6f-dca4-4556-87a8-f7d2a661023a-kube-api-access-8slxb" (OuterVolumeSpecName: "kube-api-access-8slxb") pod "8a4dea6f-dca4-4556-87a8-f7d2a661023a" (UID: "8a4dea6f-dca4-4556-87a8-f7d2a661023a"). InnerVolumeSpecName "kube-api-access-8slxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:16:24.160081 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.160048 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8a4dea6f-dca4-4556-87a8-f7d2a661023a" (UID: "8a4dea6f-dca4-4556-87a8-f7d2a661023a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:16:24.259275 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.259221 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8slxb\" (UniqueName: \"kubernetes.io/projected/8a4dea6f-dca4-4556-87a8-f7d2a661023a-kube-api-access-8slxb\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:16:24.259275 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.259243 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4dea6f-dca4-4556-87a8-f7d2a661023a-webhook-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:16:24.714551 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.714514 2566 generic.go:358] "Generic (PLEG): container finished" podID="8a4dea6f-dca4-4556-87a8-f7d2a661023a" containerID="3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959" exitCode=0 May 27 21:16:24.714966 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.714568 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c667dd69-68p62" May 27 21:16:24.714966 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.714595 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c667dd69-68p62" event={"ID":"8a4dea6f-dca4-4556-87a8-f7d2a661023a","Type":"ContainerDied","Data":"3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959"} May 27 21:16:24.714966 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.714630 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c667dd69-68p62" event={"ID":"8a4dea6f-dca4-4556-87a8-f7d2a661023a","Type":"ContainerDied","Data":"3a96575a4cf4dc72b9a24e40cdf97ab3ae6f126a88f4c1b85c85648dcde12427"} May 27 21:16:24.714966 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.714645 2566 scope.go:117] "RemoveContainer" containerID="3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959" May 27 21:16:24.725041 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.724899 2566 scope.go:117] "RemoveContainer" containerID="3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959" May 27 21:16:24.725479 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:24.725446 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959\": container with ID starting with 3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959 not found: ID does not exist" containerID="3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959" May 27 21:16:24.725593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.725497 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959"} err="failed to get container status \"3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959\": rpc error: code = NotFound desc = could not find container \"3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959\": container with ID starting with 3e68ad59b72ab6158315ad39770efedd93ee00a1e36cdf2b66affd29f8c80959 not found: ID does not exist" May 27 21:16:24.745386 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.745361 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c667dd69-68p62"] May 27 21:16:24.746832 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:24.746809 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84c667dd69-68p62"] May 27 21:16:25.698010 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:25.697981 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a4dea6f-dca4-4556-87a8-f7d2a661023a" path="/var/lib/kubelet/pods/8a4dea6f-dca4-4556-87a8-f7d2a661023a/volumes" May 27 21:16:41.713085 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.712884 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-d9bbb664d-gbwth"] May 27 21:16:41.717044 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.714286 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a4dea6f-dca4-4556-87a8-f7d2a661023a" containerName="manager" May 27 21:16:41.717044 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.714308 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a4dea6f-dca4-4556-87a8-f7d2a661023a" containerName="manager" May 27 21:16:41.717044 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.714468 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a4dea6f-dca4-4556-87a8-f7d2a661023a" containerName="manager" May 27 21:16:41.717857 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.717834 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:41.720718 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.720688 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 27 21:16:41.720847 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.720701 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2wmg6\"" May 27 21:16:41.726864 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.726843 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d9bbb664d-gbwth"] May 27 21:16:41.801780 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.801753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-maas-api-tls\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:41.801965 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.801794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdmg8\" (UniqueName: \"kubernetes.io/projected/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-kube-api-access-tdmg8\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:41.902499 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.902475 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdmg8\" (UniqueName: \"kubernetes.io/projected/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-kube-api-access-tdmg8\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:41.902643 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.902575 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-maas-api-tls\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:41.902720 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:41.902697 2566 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 27 21:16:41.902791 ip-10-0-136-186 kubenswrapper[2566]: E0527 21:16:41.902777 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-maas-api-tls podName:4ec8d4a6-d7ba-445e-b568-bcaa1803d11e nodeName:}" failed. No retries permitted until 2026-05-27 21:16:42.402748556 +0000 UTC m=+627.253197597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-maas-api-tls") pod "maas-api-d9bbb664d-gbwth" (UID: "4ec8d4a6-d7ba-445e-b568-bcaa1803d11e") : secret "maas-api-serving-cert" not found May 27 21:16:41.913984 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:41.913960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdmg8\" (UniqueName: \"kubernetes.io/projected/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-kube-api-access-tdmg8\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:42.406414 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:42.406383 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-maas-api-tls\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:42.408964 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:42.408910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ec8d4a6-d7ba-445e-b568-bcaa1803d11e-maas-api-tls\") pod \"maas-api-d9bbb664d-gbwth\" (UID: \"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e\") " pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:42.629677 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:42.629636 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:42.756942 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:42.756883 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d9bbb664d-gbwth"] May 27 21:16:42.760095 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:16:42.760070 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec8d4a6_d7ba_445e_b568_bcaa1803d11e.slice/crio-74275624adc7e44ebea0ce9c19acc576ef64cd3a2c460baa73f4a88db9f2aa63 WatchSource:0}: Error finding container 74275624adc7e44ebea0ce9c19acc576ef64cd3a2c460baa73f4a88db9f2aa63: Status 404 returned error can't find the container with id 74275624adc7e44ebea0ce9c19acc576ef64cd3a2c460baa73f4a88db9f2aa63 May 27 21:16:42.780067 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:42.780042 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d9bbb664d-gbwth" event={"ID":"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e","Type":"ContainerStarted","Data":"74275624adc7e44ebea0ce9c19acc576ef64cd3a2c460baa73f4a88db9f2aa63"} May 27 21:16:44.787893 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:44.787859 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d9bbb664d-gbwth" event={"ID":"4ec8d4a6-d7ba-445e-b568-bcaa1803d11e","Type":"ContainerStarted","Data":"922decabc1bb504bab5b2b83d3cff864030eab4f2100cbd3671505497072094c"} May 27 21:16:44.788348 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:44.787974 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:16:44.830773 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:44.830725 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-d9bbb664d-gbwth" podStartSLOduration=2.093026533 podStartE2EDuration="3.830710887s" podCreationTimestamp="2026-05-27 21:16:41 +0000 UTC" firstStartedPulling="2026-05-27 21:16:42.761507884 +0000 UTC m=+627.611956920" lastFinishedPulling="2026-05-27 21:16:44.499192223 +0000 UTC m=+629.349641274" observedRunningTime="2026-05-27 21:16:44.828350312 +0000 UTC m=+629.678799368" watchObservedRunningTime="2026-05-27 21:16:44.830710887 +0000 UTC m=+629.681159984" May 27 21:16:50.796677 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:16:50.796650 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-d9bbb664d-gbwth" May 27 21:17:32.551339 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.551290 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x"] May 27 21:17:32.561005 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.560979 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.564672 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.564538 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 21:17:32.564672 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.564545 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 27 21:17:32.564672 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.564558 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 21:17:32.564672 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.564601 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-knrtt\"" May 27 21:17:32.565996 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.565971 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x"] May 27 21:17:32.643395 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.643360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.643395 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.643397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.643616 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.643421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j47f\" (UniqueName: \"kubernetes.io/projected/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-kube-api-access-9j47f\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.643616 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.643510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.643616 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.643552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.643616 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.643615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744375 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744585 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744433 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744585 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744585 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744503 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j47f\" (UniqueName: \"kubernetes.io/projected/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-kube-api-access-9j47f\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744585 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744536 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744585 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744566 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744913 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.744913 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.745054 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.744970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.746773 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.746749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.747012 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.746994 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.753102 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.753081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j47f\" (UniqueName: \"kubernetes.io/projected/54d476d6-5f48-4a5e-aeee-6ba0abc32f98-kube-api-access-9j47f\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-swf7x\" (UID: \"54d476d6-5f48-4a5e-aeee-6ba0abc32f98\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:32.873103 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:32.873020 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:33.019266 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:33.019230 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x"] May 27 21:17:33.023152 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:17:33.023120 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d476d6_5f48_4a5e_aeee_6ba0abc32f98.slice/crio-596a87e345f409ecfc5e0c50f20f36e21dd02ddb215006a7248658067d1f0568 WatchSource:0}: Error finding container 596a87e345f409ecfc5e0c50f20f36e21dd02ddb215006a7248658067d1f0568: Status 404 returned error can't find the container with id 596a87e345f409ecfc5e0c50f20f36e21dd02ddb215006a7248658067d1f0568 May 27 21:17:33.025105 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:33.025087 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:17:33.950975 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:33.950945 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" event={"ID":"54d476d6-5f48-4a5e-aeee-6ba0abc32f98","Type":"ContainerStarted","Data":"596a87e345f409ecfc5e0c50f20f36e21dd02ddb215006a7248658067d1f0568"} May 27 21:17:39.979453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:39.979417 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" event={"ID":"54d476d6-5f48-4a5e-aeee-6ba0abc32f98","Type":"ContainerStarted","Data":"2d28bb28098edf410336601562f085ca8bdd4e1c6e6cee23d0f433b5b90150e6"} May 27 21:17:41.542164 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.542125 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd"] May 27 21:17:41.551364 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.551332 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.554302 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.554242 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 27 21:17:41.558423 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.558394 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd"] May 27 21:17:41.622138 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.622098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.622291 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.622153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.622291 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.622209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfl4g\" (UniqueName: \"kubernetes.io/projected/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-kube-api-access-lfl4g\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.622291 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.622228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.622291 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.622257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.622540 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.622328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723184 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723155 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfl4g\" (UniqueName: \"kubernetes.io/projected/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-kube-api-access-lfl4g\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723184 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723419 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723419 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723340 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723425 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723510 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723627 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.723855 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.724014 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.723993 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.726017 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.725978 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.726286 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.726266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.733708 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.733678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfl4g\" (UniqueName: \"kubernetes.io/projected/5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7-kube-api-access-lfl4g\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd\" (UID: \"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:41.863133 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:41.863058 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:42.000736 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:42.000704 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd"] May 27 21:17:42.004164 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:17:42.004136 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dff5f11_a2dd_46bd_a8e7_5e12b48a09b7.slice/crio-83d0d6f1e8bc02e8d417945225f5a53d93caf11910ecf17556ac781c3c7f0220 WatchSource:0}: Error finding container 83d0d6f1e8bc02e8d417945225f5a53d93caf11910ecf17556ac781c3c7f0220: Status 404 returned error can't find the container with id 83d0d6f1e8bc02e8d417945225f5a53d93caf11910ecf17556ac781c3c7f0220 May 27 21:17:42.992986 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:42.992950 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" event={"ID":"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7","Type":"ContainerStarted","Data":"73fa7ce80b9db486f26ae8d4aa35bffb37641d2eed19804b37191d5709f26f13"} May 27 21:17:42.992986 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:42.992990 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" event={"ID":"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7","Type":"ContainerStarted","Data":"83d0d6f1e8bc02e8d417945225f5a53d93caf11910ecf17556ac781c3c7f0220"} May 27 21:17:45.002287 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:45.002253 2566 generic.go:358] "Generic (PLEG): container finished" podID="54d476d6-5f48-4a5e-aeee-6ba0abc32f98" containerID="2d28bb28098edf410336601562f085ca8bdd4e1c6e6cee23d0f433b5b90150e6" exitCode=0 May 27 21:17:45.002751 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:45.002299 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" event={"ID":"54d476d6-5f48-4a5e-aeee-6ba0abc32f98","Type":"ContainerDied","Data":"2d28bb28098edf410336601562f085ca8bdd4e1c6e6cee23d0f433b5b90150e6"} May 27 21:17:47.012025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:47.011987 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" event={"ID":"54d476d6-5f48-4a5e-aeee-6ba0abc32f98","Type":"ContainerStarted","Data":"cc900e4bc7e863e35812b36835e49eeeb558b815de9090747e20f6cf0b93f266"} May 27 21:17:47.012475 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:47.012200 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:17:48.017025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:48.016912 2566 generic.go:358] "Generic (PLEG): container finished" podID="5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7" containerID="73fa7ce80b9db486f26ae8d4aa35bffb37641d2eed19804b37191d5709f26f13" exitCode=0 May 27 21:17:48.017025 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:48.016988 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" event={"ID":"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7","Type":"ContainerDied","Data":"73fa7ce80b9db486f26ae8d4aa35bffb37641d2eed19804b37191d5709f26f13"} May 27 21:17:48.035695 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:48.035628 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" podStartSLOduration=2.969563099 podStartE2EDuration="16.035609701s" podCreationTimestamp="2026-05-27 21:17:32 +0000 UTC" firstStartedPulling="2026-05-27 21:17:33.025242575 +0000 UTC m=+677.875691610" lastFinishedPulling="2026-05-27 21:17:46.091289173 +0000 UTC m=+690.941738212" observedRunningTime="2026-05-27 21:17:47.039005614 +0000 UTC m=+691.889454671" watchObservedRunningTime="2026-05-27 21:17:48.035609701 +0000 UTC m=+692.886058759" May 27 21:17:49.022454 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:49.022421 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" event={"ID":"5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7","Type":"ContainerStarted","Data":"b216921cc553f808fb02f3020d9ae9b76941b10961b2a6303090745e55ef02c5"} May 27 21:17:49.022840 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:49.022631 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:17:49.044609 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:49.044558 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" podStartSLOduration=7.792126143 podStartE2EDuration="8.044544425s" podCreationTimestamp="2026-05-27 21:17:41 +0000 UTC" firstStartedPulling="2026-05-27 21:17:48.017711856 +0000 UTC m=+692.868160891" lastFinishedPulling="2026-05-27 21:17:48.270130134 +0000 UTC m=+693.120579173" observedRunningTime="2026-05-27 21:17:49.042910851 +0000 UTC m=+693.893359924" watchObservedRunningTime="2026-05-27 21:17:49.044544425 +0000 UTC m=+693.894993481" May 27 21:17:58.030802 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:17:58.030773 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-swf7x" May 27 21:18:00.038912 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:00.038879 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd" May 27 21:18:33.859405 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.859323 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm"] May 27 21:18:33.863080 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.863058 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:33.866021 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.866000 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 27 21:18:33.873148 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.873123 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm"] May 27 21:18:33.980290 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.980254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:33.980450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.980309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fbc81ae-8684-4880-877d-631b54bfa20e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:33.980450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.980327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:33.980450 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.980382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wzvv\" (UniqueName: \"kubernetes.io/projected/4fbc81ae-8684-4880-877d-631b54bfa20e-kube-api-access-4wzvv\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:33.980557 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.980448 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:33.980557 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:33.980479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081234 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081201 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081326 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081407 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081387 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fbc81ae-8684-4880-877d-631b54bfa20e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081504 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081413 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081504 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081432 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wzvv\" (UniqueName: \"kubernetes.io/projected/4fbc81ae-8684-4880-877d-631b54bfa20e-kube-api-access-4wzvv\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081504 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081475 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081778 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081745 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081870 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.081870 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.081834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.083863 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.083832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fbc81ae-8684-4880-877d-631b54bfa20e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.083863 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.083838 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fbc81ae-8684-4880-877d-631b54bfa20e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.090245 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.090226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wzvv\" (UniqueName: \"kubernetes.io/projected/4fbc81ae-8684-4880-877d-631b54bfa20e-kube-api-access-4wzvv\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm\" (UID: \"4fbc81ae-8684-4880-877d-631b54bfa20e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.173099 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.173019 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:34.302049 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:34.302022 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm"] May 27 21:18:34.303683 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:18:34.303660 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbc81ae_8684_4880_877d_631b54bfa20e.slice/crio-8140ec3c824626f940403a149490951b6a88463b461c4810d5557abb2b5e39a9 WatchSource:0}: Error finding container 8140ec3c824626f940403a149490951b6a88463b461c4810d5557abb2b5e39a9: Status 404 returned error can't find the container with id 8140ec3c824626f940403a149490951b6a88463b461c4810d5557abb2b5e39a9 May 27 21:18:35.180197 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:35.180161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" event={"ID":"4fbc81ae-8684-4880-877d-631b54bfa20e","Type":"ContainerStarted","Data":"cf24bf377f63d9cee94b8672b8b59e1dbe93485eacede0860a5e77f9f295b9f0"} May 27 21:18:35.180197 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:35.180204 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" event={"ID":"4fbc81ae-8684-4880-877d-631b54bfa20e","Type":"ContainerStarted","Data":"8140ec3c824626f940403a149490951b6a88463b461c4810d5557abb2b5e39a9"} May 27 21:18:43.207882 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:43.207849 2566 generic.go:358] "Generic (PLEG): container finished" podID="4fbc81ae-8684-4880-877d-631b54bfa20e" containerID="cf24bf377f63d9cee94b8672b8b59e1dbe93485eacede0860a5e77f9f295b9f0" exitCode=0 May 27 21:18:43.208275 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:43.207933 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" event={"ID":"4fbc81ae-8684-4880-877d-631b54bfa20e","Type":"ContainerDied","Data":"cf24bf377f63d9cee94b8672b8b59e1dbe93485eacede0860a5e77f9f295b9f0"} May 27 21:18:44.213870 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:44.213838 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" event={"ID":"4fbc81ae-8684-4880-877d-631b54bfa20e","Type":"ContainerStarted","Data":"3d87408e25cc7f99c7dc05e3b45325aa36ec0b889cea13f83bcad760501aee1d"} May 27 21:18:44.214286 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:44.214053 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:18:44.238101 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:44.238048 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" podStartSLOduration=10.991058392 podStartE2EDuration="11.238033598s" podCreationTimestamp="2026-05-27 21:18:33 +0000 UTC" firstStartedPulling="2026-05-27 21:18:43.208485089 +0000 UTC m=+748.058934124" lastFinishedPulling="2026-05-27 21:18:43.455460281 +0000 UTC m=+748.305909330" observedRunningTime="2026-05-27 21:18:44.237367238 +0000 UTC m=+749.087816296" watchObservedRunningTime="2026-05-27 21:18:44.238033598 +0000 UTC m=+749.088482657" May 27 21:18:55.230043 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:18:55.230013 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm" May 27 21:20:23.316447 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.316378 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6485588796-fttfp"] May 27 21:20:23.317317 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.316694 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6485588796-fttfp" podUID="81577355-9911-4eb4-adab-fa66d4ec50fd" containerName="manager" containerID="cri-o://0c409e6dab8a8156c238ab17b692c800a5f1944b616f6df6e13064802d807bb6" gracePeriod=30 May 27 21:20:23.554949 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.554904 2566 generic.go:358] "Generic (PLEG): container finished" podID="81577355-9911-4eb4-adab-fa66d4ec50fd" containerID="0c409e6dab8a8156c238ab17b692c800a5f1944b616f6df6e13064802d807bb6" exitCode=0 May 27 21:20:23.555035 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.554973 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485588796-fttfp" event={"ID":"81577355-9911-4eb4-adab-fa66d4ec50fd","Type":"ContainerDied","Data":"0c409e6dab8a8156c238ab17b692c800a5f1944b616f6df6e13064802d807bb6"} May 27 21:20:23.555035 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.555008 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485588796-fttfp" event={"ID":"81577355-9911-4eb4-adab-fa66d4ec50fd","Type":"ContainerDied","Data":"a3ea44e65599140440e7bc304f51361d1a72ef241aa19c664889c37a544cfc3b"} May 27 21:20:23.555035 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.555018 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3ea44e65599140440e7bc304f51361d1a72ef241aa19c664889c37a544cfc3b" May 27 21:20:23.567279 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.567220 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:20:23.616869 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.616841 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81577355-9911-4eb4-adab-fa66d4ec50fd-webhook-cert\") pod \"81577355-9911-4eb4-adab-fa66d4ec50fd\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " May 27 21:20:23.617055 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.616933 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwf27\" (UniqueName: \"kubernetes.io/projected/81577355-9911-4eb4-adab-fa66d4ec50fd-kube-api-access-dwf27\") pod \"81577355-9911-4eb4-adab-fa66d4ec50fd\" (UID: \"81577355-9911-4eb4-adab-fa66d4ec50fd\") " May 27 21:20:23.619007 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.618973 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81577355-9911-4eb4-adab-fa66d4ec50fd-kube-api-access-dwf27" (OuterVolumeSpecName: "kube-api-access-dwf27") pod "81577355-9911-4eb4-adab-fa66d4ec50fd" (UID: "81577355-9911-4eb4-adab-fa66d4ec50fd"). InnerVolumeSpecName "kube-api-access-dwf27". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:20:23.619111 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.619060 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81577355-9911-4eb4-adab-fa66d4ec50fd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "81577355-9911-4eb4-adab-fa66d4ec50fd" (UID: "81577355-9911-4eb4-adab-fa66d4ec50fd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:20:23.717711 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.717684 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81577355-9911-4eb4-adab-fa66d4ec50fd-webhook-cert\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:20:23.717844 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:23.717788 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwf27\" (UniqueName: \"kubernetes.io/projected/81577355-9911-4eb4-adab-fa66d4ec50fd-kube-api-access-dwf27\") on node \"ip-10-0-136-186.ec2.internal\" DevicePath \"\"" May 27 21:20:24.558293 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:24.558260 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485588796-fttfp" May 27 21:20:24.576590 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:24.576556 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6485588796-fttfp"] May 27 21:20:24.583332 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:24.583304 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6485588796-fttfp"] May 27 21:20:25.048134 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.048092 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6485588796-bt224"] May 27 21:20:25.048566 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.048547 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81577355-9911-4eb4-adab-fa66d4ec50fd" containerName="manager" May 27 21:20:25.048681 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.048570 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="81577355-9911-4eb4-adab-fa66d4ec50fd" containerName="manager" May 27 21:20:25.048736 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.048684 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="81577355-9911-4eb4-adab-fa66d4ec50fd" containerName="manager" May 27 21:20:25.050882 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.050860 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.054836 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.054814 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" May 27 21:20:25.054954 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.054863 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4hw85\"" May 27 21:20:25.054954 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.054890 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 21:20:25.063532 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.063506 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485588796-bt224"] May 27 21:20:25.127810 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.127770 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sxc4\" (UniqueName: \"kubernetes.io/projected/280c9bf4-62ad-4332-ba9a-4c47f1e8e81e-kube-api-access-5sxc4\") pod \"maas-controller-6485588796-bt224\" (UID: \"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e\") " pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.127999 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.127855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/280c9bf4-62ad-4332-ba9a-4c47f1e8e81e-webhook-cert\") pod \"maas-controller-6485588796-bt224\" (UID: \"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e\") " pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.228531 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.228491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/280c9bf4-62ad-4332-ba9a-4c47f1e8e81e-webhook-cert\") pod \"maas-controller-6485588796-bt224\" (UID: \"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e\") " pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.228694 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.228617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxc4\" (UniqueName: \"kubernetes.io/projected/280c9bf4-62ad-4332-ba9a-4c47f1e8e81e-kube-api-access-5sxc4\") pod \"maas-controller-6485588796-bt224\" (UID: \"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e\") " pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.231032 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.231013 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/280c9bf4-62ad-4332-ba9a-4c47f1e8e81e-webhook-cert\") pod \"maas-controller-6485588796-bt224\" (UID: \"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e\") " pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.246682 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.246654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sxc4\" (UniqueName: \"kubernetes.io/projected/280c9bf4-62ad-4332-ba9a-4c47f1e8e81e-kube-api-access-5sxc4\") pod \"maas-controller-6485588796-bt224\" (UID: \"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e\") " pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.361422 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.361339 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:25.497210 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.497187 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485588796-bt224"] May 27 21:20:25.499876 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:20:25.499845 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280c9bf4_62ad_4332_ba9a_4c47f1e8e81e.slice/crio-2446385a3141fb8eb712e6c31e15d2a818b2079e60dbbc50de4a8d35577a4bd9 WatchSource:0}: Error finding container 2446385a3141fb8eb712e6c31e15d2a818b2079e60dbbc50de4a8d35577a4bd9: Status 404 returned error can't find the container with id 2446385a3141fb8eb712e6c31e15d2a818b2079e60dbbc50de4a8d35577a4bd9 May 27 21:20:25.562297 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.562266 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485588796-bt224" event={"ID":"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e","Type":"ContainerStarted","Data":"2446385a3141fb8eb712e6c31e15d2a818b2079e60dbbc50de4a8d35577a4bd9"} May 27 21:20:25.697397 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:25.697321 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81577355-9911-4eb4-adab-fa66d4ec50fd" path="/var/lib/kubelet/pods/81577355-9911-4eb4-adab-fa66d4ec50fd/volumes" May 27 21:20:26.566380 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:26.566342 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485588796-bt224" event={"ID":"280c9bf4-62ad-4332-ba9a-4c47f1e8e81e","Type":"ContainerStarted","Data":"62d513546fede45f592e4475f2f8edb4c13396a3d10199f43e96a4ca63a0c8c3"} May 27 21:20:26.566380 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:26.566386 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:20:26.585222 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:26.585176 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6485588796-bt224" podStartSLOduration=1.195979157 podStartE2EDuration="1.585163389s" podCreationTimestamp="2026-05-27 21:20:25 +0000 UTC" firstStartedPulling="2026-05-27 21:20:25.501198931 +0000 UTC m=+850.351647966" lastFinishedPulling="2026-05-27 21:20:25.890383161 +0000 UTC m=+850.740832198" observedRunningTime="2026-05-27 21:20:26.584485185 +0000 UTC m=+851.434934240" watchObservedRunningTime="2026-05-27 21:20:26.585163389 +0000 UTC m=+851.435612445" May 27 21:20:37.576379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:20:37.576347 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6485588796-bt224" May 27 21:21:15.641755 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:21:15.641667 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:21:15.643246 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:21:15.643222 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:22:15.666824 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:22:15.666791 2566 scope.go:117] "RemoveContainer" containerID="0c409e6dab8a8156c238ab17b692c800a5f1944b616f6df6e13064802d807bb6" May 27 21:26:15.666163 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:26:15.666133 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:26:15.668847 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:26:15.668827 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:31:15.690037 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:31:15.690005 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:31:15.694378 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:31:15.694355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:36:15.714837 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:36:15.714809 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:36:15.720405 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:36:15.720385 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:41:06.699705 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:06.699670 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d9bbb664d-gbwth_4ec8d4a6-d7ba-445e-b568-bcaa1803d11e/maas-api/0.log" May 27 21:41:06.931340 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:06.931305 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6485588796-bt224_280c9bf4-62ad-4332-ba9a-4c47f1e8e81e/manager/0.log" May 27 21:41:07.163382 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:07.163351 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6678cd66dc-4gkvp_620ffd7a-5583-42a9-9936-13fa3f5655ca/manager/0.log" May 27 21:41:08.819028 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:08.818998 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-2jr6f_43944bb2-4546-4ea3-9386-bbefa6412f64/manager/0.log" May 27 21:41:08.929064 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:08.929021 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-q489f_d7bc7b24-5b30-4a06-a6b7-c434d897f2ae/manager/0.log" May 27 21:41:09.149414 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:09.149346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lrdtb_3809051c-da7b-49df-a550-80e4a7349f2a/registry-server/0.log" May 27 21:41:09.506744 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:09.506640 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-7lgqw_05d153aa-53b1-486e-b2ca-535a4f978ada/manager/0.log" May 27 21:41:09.835405 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:09.835361 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8r8cl8_7d2f1069-d48a-4e33-8caf-73007c7c7f39/istio-proxy/0.log" May 27 21:41:10.498998 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:10.498971 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b587b8bd4-k9vw6_c378c8d3-c577-4110-a45a-3ddd5ae59503/router/0.log" May 27 21:41:11.053187 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:11.053082 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-swf7x_54d476d6-5f48-4a5e-aeee-6ba0abc32f98/storage-initializer/0.log" May 27 21:41:11.061270 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:11.061239 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-swf7x_54d476d6-5f48-4a5e-aeee-6ba0abc32f98/main/0.log" May 27 21:41:11.285288 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:11.285260 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd_5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7/storage-initializer/0.log" May 27 21:41:11.292990 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:11.292965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-47xzd_5dff5f11-a2dd-46bd-a8e7-5e12b48a09b7/main/0.log" May 27 21:41:11.397812 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:11.397733 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm_4fbc81ae-8684-4880-877d-631b54bfa20e/storage-initializer/0.log" May 27 21:41:11.406367 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:11.406342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-6lpzm_4fbc81ae-8684-4880-877d-631b54bfa20e/main/0.log" May 27 21:41:15.737446 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:15.737420 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:41:15.744833 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:15.744814 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:41:18.678251 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:18.678220 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7whx7_f858b472-d81f-4a62-978b-0df92a5dd499/global-pull-secret-syncer/0.log" May 27 21:41:18.777959 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:18.777914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5wcrn_488f66be-50d6-4b6d-8562-af99bc8c5500/konnectivity-agent/0.log" May 27 21:41:18.958104 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:18.958035 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-186.ec2.internal_d24a65f211e44ac29fef88123454ce57/haproxy/0.log" May 27 21:41:22.806048 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:22.806020 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-2jr6f_43944bb2-4546-4ea3-9386-bbefa6412f64/manager/0.log" May 27 21:41:22.829807 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:22.829769 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-q489f_d7bc7b24-5b30-4a06-a6b7-c434d897f2ae/manager/0.log" May 27 21:41:22.904298 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:22.904277 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lrdtb_3809051c-da7b-49df-a550-80e4a7349f2a/registry-server/0.log" May 27 21:41:23.082597 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:23.082521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-7lgqw_05d153aa-53b1-486e-b2ca-535a4f978ada/manager/0.log" May 27 21:41:24.760394 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:24.760322 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-5kb5m_7ab8ea35-c6dd-4b9a-a0c1-8209add5b314/cluster-monitoring-operator/0.log" May 27 21:41:24.790221 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:24.790202 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gn9gv_dd13556b-e72f-4036-8ed9-f54e00d9a7c8/kube-state-metrics/0.log" May 27 21:41:24.808705 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:24.808684 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gn9gv_dd13556b-e72f-4036-8ed9-f54e00d9a7c8/kube-rbac-proxy-main/0.log" May 27 21:41:24.837346 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:24.837308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gn9gv_dd13556b-e72f-4036-8ed9-f54e00d9a7c8/kube-rbac-proxy-self/0.log" May 27 21:41:24.878107 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:24.878083 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8488fd6994-rx59w_a2cd93bb-697b-4136-b18c-135046942354/metrics-server/0.log" May 27 21:41:25.021759 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.021681 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht6bt_6f10bebb-94a1-44fb-a2d8-737b536e18ef/node-exporter/0.log" May 27 21:41:25.045238 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.045214 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht6bt_6f10bebb-94a1-44fb-a2d8-737b536e18ef/kube-rbac-proxy/0.log" May 27 21:41:25.066572 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.066556 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht6bt_6f10bebb-94a1-44fb-a2d8-737b536e18ef/init-textfile/0.log" May 27 21:41:25.268771 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.268708 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/prometheus/0.log" May 27 21:41:25.290312 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.290288 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/config-reloader/0.log" May 27 21:41:25.312972 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.312949 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/thanos-sidecar/0.log" May 27 21:41:25.338545 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.338525 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/kube-rbac-proxy-web/0.log" May 27 21:41:25.360137 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.360116 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/kube-rbac-proxy/0.log" May 27 21:41:25.381828 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.381810 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/kube-rbac-proxy-thanos/0.log" May 27 21:41:25.404646 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.404630 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61d80059-54de-4c6a-950b-dec84198de18/init-config-reloader/0.log" May 27 21:41:25.489575 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:25.489552 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-k2tj6_8795a564-2373-462b-91d3-33a314e0629c/prometheus-operator-admission-webhook/0.log" May 27 21:41:27.386179 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.386142 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm"] May 27 21:41:27.389442 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.389421 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.391900 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.391878 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t5vz8\"/\"openshift-service-ca.crt\"" May 27 21:41:27.392044 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.392016 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t5vz8\"/\"kube-root-ca.crt\"" May 27 21:41:27.392106 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.392067 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t5vz8\"/\"default-dockercfg-qz47r\"" May 27 21:41:27.396648 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.396443 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm"] May 27 21:41:27.463237 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.463199 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-podres\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.463379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.463250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-proc\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.463379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.463269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zb5v\" (UniqueName: \"kubernetes.io/projected/4495a208-90aa-4c39-be1f-ac7316caa748-kube-api-access-8zb5v\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.463379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.463296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-sys\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.463379 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.463354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-lib-modules\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564331 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564305 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-proc\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564459 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564339 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zb5v\" (UniqueName: \"kubernetes.io/projected/4495a208-90aa-4c39-be1f-ac7316caa748-kube-api-access-8zb5v\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564459 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564377 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-sys\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564459 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564422 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-proc\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564459 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564427 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-lib-modules\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564500 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-podres\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564511 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-sys\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564593 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-lib-modules\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.564816 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.564623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4495a208-90aa-4c39-be1f-ac7316caa748-podres\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.572385 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.572358 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zb5v\" (UniqueName: \"kubernetes.io/projected/4495a208-90aa-4c39-be1f-ac7316caa748-kube-api-access-8zb5v\") pod \"perf-node-gather-daemonset-pwrsm\" (UID: \"4495a208-90aa-4c39-be1f-ac7316caa748\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.699668 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.699611 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:27.821736 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.821714 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm"] May 27 21:41:27.824376 ip-10-0-136-186 kubenswrapper[2566]: W0527 21:41:27.824350 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4495a208_90aa_4c39_be1f_ac7316caa748.slice/crio-540c436239ce849ebfc3acaaa3f1609d592218cfc43ab159b45fd0b72611ec53 WatchSource:0}: Error finding container 540c436239ce849ebfc3acaaa3f1609d592218cfc43ab159b45fd0b72611ec53: Status 404 returned error can't find the container with id 540c436239ce849ebfc3acaaa3f1609d592218cfc43ab159b45fd0b72611ec53 May 27 21:41:27.826021 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.826006 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:41:27.857453 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.857425 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" event={"ID":"4495a208-90aa-4c39-be1f-ac7316caa748","Type":"ContainerStarted","Data":"540c436239ce849ebfc3acaaa3f1609d592218cfc43ab159b45fd0b72611ec53"} May 27 21:41:27.932231 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:27.932209 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f5d779c8d-4qrp5_d9fc71ec-300e-4261-a489-f18f0d085f9a/console/0.log" May 27 21:41:28.861808 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:28.861778 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" event={"ID":"4495a208-90aa-4c39-be1f-ac7316caa748","Type":"ContainerStarted","Data":"97130a7f04cbd08563b335a7d81c24606d43fcb615dae986774b4559f971ef7b"} May 27 21:41:28.862211 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:28.861862 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:28.879529 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:28.879488 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" podStartSLOduration=1.879476835 podStartE2EDuration="1.879476835s" podCreationTimestamp="2026-05-27 21:41:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:41:28.878209975 +0000 UTC m=+2113.728659033" watchObservedRunningTime="2026-05-27 21:41:28.879476835 +0000 UTC m=+2113.729925904" May 27 21:41:29.395000 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:29.394973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njhk2_cdddf309-c048-451c-a65b-2fc7065e56fa/dns/0.log" May 27 21:41:29.415810 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:29.415786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njhk2_cdddf309-c048-451c-a65b-2fc7065e56fa/kube-rbac-proxy/0.log" May 27 21:41:29.488078 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:29.488055 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v7cwz_c0dbdf25-c120-422a-b5ed-e2787733801d/dns-node-resolver/0.log" May 27 21:41:29.961552 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:29.961522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c564c7797-gg7d4_91a159b4-d132-4626-97e8-3b96f3839ab6/registry/0.log" May 27 21:41:30.031083 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:30.031054 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sw768_0dc2df21-ae9a-44cc-9ae1-c6495f563ff4/node-ca/0.log" May 27 21:41:30.944112 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:30.944080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8r8cl8_7d2f1069-d48a-4e33-8caf-73007c7c7f39/istio-proxy/0.log" May 27 21:41:31.215728 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:31.215643 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b587b8bd4-k9vw6_c378c8d3-c577-4110-a45a-3ddd5ae59503/router/0.log" May 27 21:41:31.765725 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:31.765695 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zw2qv_d4b66618-2f2b-442d-9cc1-0246ec8b7bda/serve-healthcheck-canary/0.log" May 27 21:41:32.253215 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:32.253186 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wxbr_4917669f-acfb-4394-bec3-fa0e9ecdff38/kube-rbac-proxy/0.log" May 27 21:41:32.274993 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:32.274962 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wxbr_4917669f-acfb-4394-bec3-fa0e9ecdff38/exporter/0.log" May 27 21:41:32.299060 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:32.299040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wxbr_4917669f-acfb-4394-bec3-fa0e9ecdff38/extractor/0.log" May 27 21:41:34.435522 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:34.435475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d9bbb664d-gbwth_4ec8d4a6-d7ba-445e-b568-bcaa1803d11e/maas-api/0.log" May 27 21:41:34.571007 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:34.570969 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6485588796-bt224_280c9bf4-62ad-4332-ba9a-4c47f1e8e81e/manager/0.log" May 27 21:41:34.629867 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:34.629838 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6678cd66dc-4gkvp_620ffd7a-5583-42a9-9936-13fa3f5655ca/manager/0.log" May 27 21:41:34.875596 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:34.875574 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-pwrsm" May 27 21:41:35.980434 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:35.980405 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dddbcdc66-qlxwb_91adf13e-a2c2-43c7-b9c3-f62b5d30a59d/manager/0.log" May 27 21:41:36.004843 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:36.004820 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-kbjqx_1d929df0-d5a3-4618-b754-48c4604fa61f/openshift-lws-operator/0.log" May 27 21:41:42.474012 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.473974 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/kube-multus-additional-cni-plugins/0.log" May 27 21:41:42.495016 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.494988 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/egress-router-binary-copy/0.log" May 27 21:41:42.516731 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.516707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/cni-plugins/0.log" May 27 21:41:42.537806 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.537786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/bond-cni-plugin/0.log" May 27 21:41:42.559164 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.559148 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/routeoverride-cni/0.log" May 27 21:41:42.579952 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.579936 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/whereabouts-cni-bincopy/0.log" May 27 21:41:42.605765 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.605749 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9kv_c90bff16-1226-4f69-acdc-f51c55cdca9a/whereabouts-cni/0.log" May 27 21:41:42.674031 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.674011 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xz2t6_7d269653-f5ca-4b41-a94f-b7258af6a4d4/kube-multus/0.log" May 27 21:41:42.696767 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.696746 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2ts5d_eb39e458-d2d6-4bb3-bf78-ef0e06839905/network-metrics-daemon/0.log" May 27 21:41:42.715267 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:42.715247 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2ts5d_eb39e458-d2d6-4bb3-bf78-ef0e06839905/kube-rbac-proxy/0.log" May 27 21:41:44.254125 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.254098 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-controller/0.log" May 27 21:41:44.271637 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.271613 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/0.log" May 27 21:41:44.289376 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.289348 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovn-acl-logging/1.log" May 27 21:41:44.313381 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.313357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/kube-rbac-proxy-node/0.log" May 27 21:41:44.339220 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.339202 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/kube-rbac-proxy-ovn-metrics/0.log" May 27 21:41:44.356631 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.356607 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/northd/0.log" May 27 21:41:44.376977 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.376944 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/nbdb/0.log" May 27 21:41:44.397571 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.397547 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/sbdb/0.log" May 27 21:41:44.564342 ip-10-0-136-186 kubenswrapper[2566]: I0527 21:41:44.564313 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztbxp_9c73bd75-c52d-48b5-81ea-30c402efbfe6/ovnkube-controller/0.log"