May 20 14:04:00.370784 ip-10-0-142-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 14:04:00.370797 ip-10-0-142-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 14:04:00.370805 ip-10-0-142-178 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 14:04:00.371142 ip-10-0-142-178 systemd[1]: Failed to start Kubernetes Kubelet. May 20 14:04:10.442521 ip-10-0-142-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 14:04:10.442541 ip-10-0-142-178 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fb1a209043f04270a8ea771592d84c98 -- May 20 14:06:37.854932 ip-10-0-142-178 systemd[1]: Starting Kubernetes Kubelet... May 20 14:06:38.326905 ip-10-0-142-178 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:06:38.326905 ip-10-0-142-178 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 14:06:38.326905 ip-10-0-142-178 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:06:38.326905 ip-10-0-142-178 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 14:06:38.326905 ip-10-0-142-178 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:06:38.330052 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.329962 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 14:06:38.333671 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333656 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:38.333671 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333671 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333675 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333678 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333681 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333685 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333687 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333690 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333693 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333696 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333699 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333701 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333704 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333708 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333712 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333716 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333718 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333721 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333724 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333727 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:38.333735 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333729 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333732 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333740 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333744 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333747 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333750 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333752 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333755 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333758 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333760 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333763 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333765 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333768 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333770 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333773 2555 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333776 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333778 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333781 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333783 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333786 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:38.334181 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333788 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333790 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333793 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333795 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333798 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333800 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333803 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333805 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333808 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333810 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333813 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333816 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333819 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333821 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333825 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333828 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333833 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333836 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333839 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333842 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:38.334675 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333844 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333847 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333849 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333852 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333854 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333857 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333859 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333862 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333864 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333867 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333870 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333872 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333875 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333879 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333881 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333884 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333886 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333889 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333892 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333895 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:38.335149 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333897 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333900 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333902 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333905 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333908 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.333910 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334319 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334324 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334327 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334330 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334333 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334336 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334341 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334345 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334348 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334351 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334354 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334356 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334362 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:38.335644 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334365 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334368 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334370 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334373 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334375 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334378 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334380 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334385 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334388 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334391 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334394 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334397 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334400 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334402 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334405 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334407 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334410 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334412 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334415 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:38.336091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334418 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334421 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334423 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334426 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334428 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334431 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334433 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334436 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334438 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334441 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334443 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334446 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334448 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334451 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334454 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334456 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334459 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334462 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334465 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:38.336619 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334467 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334470 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334473 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334475 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334478 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334480 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334483 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334485 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334488 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334491 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334493 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334496 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334515 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334520 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334522 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334525 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334528 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334530 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334533 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334536 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:38.337091 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334539 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334541 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334544 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334546 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334549 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334552 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334554 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334557 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334560 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334562 2555 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334565 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334567 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334570 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334572 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.334579 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334650 2555 flags.go:64] FLAG: --address="0.0.0.0" May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334659 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334666 2555 flags.go:64] FLAG: --anonymous-auth="true" May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334670 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334674 2555 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334678 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 14:06:38.337679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334684 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334692 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334697 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334701 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334707 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334712 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334715 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334718 2555 flags.go:64] FLAG: --cgroup-root="" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334721 2555 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334724 2555 flags.go:64] FLAG: --client-ca-file="" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334727 2555 flags.go:64] FLAG: --cloud-config="" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334730 2555 flags.go:64] FLAG: --cloud-provider="external" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334733 2555 flags.go:64] FLAG: --cluster-dns="[]" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334737 2555 flags.go:64] FLAG: --cluster-domain="" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334740 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334743 2555 flags.go:64] FLAG: --config-dir="" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334746 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334749 2555 flags.go:64] FLAG: --container-log-max-files="5" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334753 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334757 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334760 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334764 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334767 2555 flags.go:64] FLAG: --contention-profiling="false" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334770 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 14:06:38.338181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334773 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334777 2555 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334781 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334788 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334791 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334794 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334796 2555 flags.go:64] FLAG: --enable-load-reader="false" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334800 2555 flags.go:64] FLAG: --enable-server="true" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334803 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334810 2555 flags.go:64] FLAG: --event-burst="100" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334814 2555 flags.go:64] FLAG: --event-qps="50" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334816 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334820 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334823 2555 flags.go:64] FLAG: --eviction-hard="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334827 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334830 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334833 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334836 2555 flags.go:64] FLAG: --eviction-soft="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334839 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334842 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334845 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334848 2555 flags.go:64] FLAG: --experimental-mounter-path="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334851 2555 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334854 2555 flags.go:64] FLAG: --fail-swap-on="true" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334857 2555 flags.go:64] FLAG: --feature-gates="" May 20 14:06:38.338762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334861 2555 flags.go:64] FLAG: --file-check-frequency="20s" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334864 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334868 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334877 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334880 2555 flags.go:64] FLAG: --healthz-port="10248" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334883 2555 flags.go:64] FLAG: --help="false" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334886 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-142-178.ec2.internal" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334889 2555 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334893 2555 flags.go:64] FLAG: --http-check-frequency="20s" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334897 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334901 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334904 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334907 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334910 2555 flags.go:64] FLAG: --image-service-endpoint="" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334913 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334916 2555 flags.go:64] FLAG: --kube-api-burst="100" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334919 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334922 2555 flags.go:64] FLAG: --kube-api-qps="50" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334925 2555 flags.go:64] FLAG: --kube-reserved="" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334928 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334931 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334934 2555 flags.go:64] FLAG: --kubelet-cgroups="" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334937 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334940 2555 flags.go:64] FLAG: --lock-file="" May 20 14:06:38.339339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334942 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334945 2555 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334948 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334954 2555 flags.go:64] FLAG: --log-json-split-stream="false" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334957 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334960 2555 flags.go:64] FLAG: --log-text-split-stream="false" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334962 2555 flags.go:64] FLAG: --logging-format="text" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334965 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334969 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334971 2555 flags.go:64] FLAG: --manifest-url="" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334974 2555 flags.go:64] FLAG: --manifest-url-header="" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334978 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334982 2555 flags.go:64] FLAG: --max-open-files="1000000" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334986 2555 flags.go:64] FLAG: --max-pods="110" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334989 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334992 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.334996 2555 flags.go:64] FLAG: --memory-manager-policy="None" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335001 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335004 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335007 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335010 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335018 2555 flags.go:64] FLAG: --node-status-max-images="50" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335021 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335024 2555 flags.go:64] FLAG: --oom-score-adj="-999" May 20 14:06:38.339934 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335027 2555 flags.go:64] FLAG: --pod-cidr="" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335030 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335036 2555 flags.go:64] FLAG: --pod-manifest-path="" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335039 2555 flags.go:64] FLAG: --pod-max-pids="-1" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335042 2555 flags.go:64] FLAG: --pods-per-core="0" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335045 2555 flags.go:64] FLAG: --port="10250" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335048 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335051 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0375b7de77f8d0c1d" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335054 2555 flags.go:64] FLAG: --qos-reserved="" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335057 2555 flags.go:64] FLAG: --read-only-port="10255" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335060 2555 flags.go:64] FLAG: --register-node="true" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335063 2555 flags.go:64] FLAG: --register-schedulable="true" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335066 2555 flags.go:64] FLAG: --register-with-taints="" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335070 2555 flags.go:64] FLAG: --registry-burst="10" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335073 2555 flags.go:64] FLAG: --registry-qps="5" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335076 2555 flags.go:64] FLAG: --reserved-cpus="" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335079 2555 flags.go:64] FLAG: --reserved-memory="" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335083 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335086 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335089 2555 flags.go:64] FLAG: --rotate-certificates="false" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335092 2555 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335096 2555 flags.go:64] FLAG: --runonce="false" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335100 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335103 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335106 2555 flags.go:64] FLAG: --seccomp-default="false" May 20 14:06:38.340497 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335112 2555 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335115 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335118 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335122 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335125 2555 flags.go:64] FLAG: --storage-driver-password="root" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335128 2555 flags.go:64] FLAG: --storage-driver-secure="false" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335131 2555 flags.go:64] FLAG: --storage-driver-table="stats" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335133 2555 flags.go:64] FLAG: --storage-driver-user="root" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335136 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335139 2555 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335142 2555 flags.go:64] FLAG: --system-cgroups="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335145 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335150 2555 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335154 2555 flags.go:64] FLAG: --tls-cert-file="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335157 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335163 2555 flags.go:64] FLAG: --tls-min-version="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335166 2555 flags.go:64] FLAG: --tls-private-key-file="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335170 2555 flags.go:64] FLAG: --topology-manager-policy="none" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335173 2555 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335176 2555 flags.go:64] FLAG: --topology-manager-scope="container" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335179 2555 flags.go:64] FLAG: --v="2" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335183 2555 flags.go:64] FLAG: --version="false" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335188 2555 flags.go:64] FLAG: --vmodule="" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335192 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.335195 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 14:06:38.341107 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335288 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335291 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335294 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335298 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335301 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335304 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335307 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335312 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335315 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335318 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335320 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335323 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335326 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335328 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335331 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335333 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335336 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335338 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335341 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335343 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:38.342031 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335346 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335349 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335351 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335353 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335356 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335359 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335361 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335364 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335367 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335370 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335372 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335409 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335413 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335416 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335419 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335423 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335426 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335430 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335436 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335440 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:38.342888 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335443 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335446 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335449 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335452 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335455 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335458 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335461 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335464 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335467 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335470 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335472 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335475 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335478 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335481 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335484 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335487 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335489 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335492 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335495 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:38.343785 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335497 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335513 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335517 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335519 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335523 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335527 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335530 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335533 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335536 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335538 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335541 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335544 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335547 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335550 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335553 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335555 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335558 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335561 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335564 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335566 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:38.344660 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335569 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335571 2555 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335576 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335579 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335582 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335585 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.335588 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.336263 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.343604 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.343627 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343698 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343712 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343718 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343722 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343728 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343733 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:38.345277 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343738 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343742 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343748 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343752 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343756 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343760 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343764 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343768 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343773 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343777 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343781 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343785 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343789 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343793 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343797 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343802 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343805 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343810 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343814 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343818 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:38.345759 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343822 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343826 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343831 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343837 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343844 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343857 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343862 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343868 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343872 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343877 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343881 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343885 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343889 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343894 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343898 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343902 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343907 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343911 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343915 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343919 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:38.346367 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343924 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343928 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343932 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343936 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343940 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343944 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343948 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343952 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343956 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343960 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343964 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343968 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343972 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343977 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343981 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343985 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343990 2555 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.343995 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344007 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344011 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:38.347257 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344015 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344019 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344023 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344030 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344037 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344041 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344046 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344051 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344055 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344059 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344064 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344068 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344073 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344077 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344081 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344085 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344089 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344093 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344097 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:38.347947 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344101 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.344108 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344295 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344302 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344307 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344312 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344316 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344321 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344325 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344329 2555 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344334 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344339 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344354 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344359 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344363 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344367 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:38.348406 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344371 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344376 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344381 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344385 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344389 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344393 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344397 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344402 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344406 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344410 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344414 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344418 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344423 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344427 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344431 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344435 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344439 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344444 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344448 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:38.348856 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344452 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344456 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344460 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344465 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344469 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344473 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344477 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344482 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344487 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344491 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344521 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344526 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344530 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344534 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344538 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344542 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344546 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344550 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344554 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344559 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:38.349321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344564 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344568 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344572 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344576 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344582 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344588 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344593 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344597 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344602 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344606 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344610 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344615 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344619 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344623 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344629 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344635 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344641 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344646 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344651 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:38.349995 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344656 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344661 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344666 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344670 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344683 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344687 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344692 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344696 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344700 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344704 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344708 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344713 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344717 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:38.344721 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.344730 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:06:38.350464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.345625 2555 server.go:962] "Client rotation is on, will bootstrap in background" May 20 14:06:38.351212 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.351196 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 14:06:38.352339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.352326 2555 server.go:1019] "Starting client certificate rotation" May 20 14:06:38.352439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.352424 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 14:06:38.353362 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.353351 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 14:06:38.378674 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.378640 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 14:06:38.386241 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.386217 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 14:06:38.401514 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.401489 2555 log.go:25] "Validated CRI v1 runtime API" May 20 14:06:38.407124 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.407104 2555 log.go:25] "Validated CRI v1 image API" May 20 14:06:38.408052 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.408029 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 14:06:38.408257 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.408244 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 14:06:38.412004 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.411980 2555 fs.go:135] Filesystem UUIDs: map[1ab1f396-e7b8-46df-9f88-dc82f09e8afb:/dev/nvme0n1p3 4fe69de5-500b-4d43-b27b-b6f81d42391e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 20 14:06:38.412071 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.412002 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 14:06:38.417345 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.417240 2555 manager.go:217] Machine: {Timestamp:2026-05-20 14:06:38.416695668 +0000 UTC m=+0.430246855 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118689 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21592e81d0b49b615b12f17d3a03c1 SystemUUID:ec21592e-81d0-b49b-615b-12f17d3a03c1 BootID:fb1a2090-43f0-4270-a8ea-771592d84c98 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:74:f7:0b:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:74:f7:0b:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:ef:e8:a3:25:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 14:06:38.417345 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.417339 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 14:06:38.417453 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.417418 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 14:06:38.421006 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.420982 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 14:06:38.421159 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.421009 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 14:06:38.421218 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.421169 2555 topology_manager.go:138] "Creating topology manager with none policy" May 20 14:06:38.421218 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.421178 2555 container_manager_linux.go:306] "Creating device plugin manager" May 20 14:06:38.421218 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.421187 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 14:06:38.421218 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.421204 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 14:06:38.422765 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.422755 2555 state_mem.go:36] "Initialized new in-memory state store" May 20 14:06:38.422890 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.422882 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 14:06:38.425778 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.425766 2555 kubelet.go:491] "Attempting to sync node with API server" May 20 14:06:38.425812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.425784 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 14:06:38.426454 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.426445 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 14:06:38.426487 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.426464 2555 kubelet.go:397] "Adding apiserver pod source" May 20 14:06:38.426487 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.426473 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 14:06:38.427665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.427638 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 14:06:38.427665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.427669 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 14:06:38.431575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.431540 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 14:06:38.433563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.433546 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 14:06:38.434311 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434300 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 14:06:38.434346 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434316 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 14:06:38.434346 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434323 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 14:06:38.434346 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434341 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434349 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434355 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434361 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434367 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434374 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434380 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 14:06:38.434439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434389 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 14:06:38.434708 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.434658 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 14:06:38.437667 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.437642 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 14:06:38.437667 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.437654 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 14:06:38.438015 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.438003 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 14:06:38.438050 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.438017 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 14:06:38.441027 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.441013 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 14:06:38.441106 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.441050 2555 server.go:1295] "Started kubelet" May 20 14:06:38.441199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.441143 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 14:06:38.441281 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.441195 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 14:06:38.441346 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.441211 2555 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 14:06:38.441912 ip-10-0-142-178 systemd[1]: Started Kubernetes Kubelet. May 20 14:06:38.442445 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.442431 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 14:06:38.443650 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.443635 2555 server.go:317] "Adding debug handlers to kubelet server" May 20 14:06:38.447630 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.447611 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 14:06:38.448206 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448190 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 14:06:38.448384 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448371 2555 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 14:06:38.448481 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448472 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 14:06:38.448650 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448630 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 14:06:38.448731 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448719 2555 reconstruct.go:97] "Volume reconstruction finished" May 20 14:06:38.448786 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448733 2555 reconciler.go:26] "Reconciler: start to sync state" May 20 14:06:38.448942 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448924 2555 factory.go:55] Registering systemd factory May 20 14:06:38.449009 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.448947 2555 factory.go:223] Registration of the systemd container factory successfully May 20 14:06:38.449206 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449188 2555 factory.go:153] Registering CRI-O factory May 20 14:06:38.449272 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449209 2555 factory.go:223] Registration of the crio container factory successfully May 20 14:06:38.449322 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449270 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 14:06:38.449322 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449292 2555 factory.go:103] Registering Raw factory May 20 14:06:38.449322 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449306 2555 manager.go:1196] Started watching for new ooms in manager May 20 14:06:38.449463 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449348 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 14:06:38.449808 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.449786 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:38.449879 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.449827 2555 manager.go:319] Starting recovery of all containers May 20 14:06:38.450448 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.449446 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-178.ec2.internal.18b14b3042e753db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-178.ec2.internal,UID:ip-10-0-142-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-178.ec2.internal,},FirstTimestamp:2026-05-20 14:06:38.441026523 +0000 UTC m=+0.454577708,LastTimestamp:2026-05-20 14:06:38.441026523 +0000 UTC m=+0.454577708,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-178.ec2.internal,}" May 20 14:06:38.450941 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.450919 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 14:06:38.456386 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.456197 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 20 14:06:38.457378 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.457348 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 20 14:06:38.461563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.461544 2555 manager.go:324] Recovery completed May 20 14:06:38.463546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.463525 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hj7t2" May 20 14:06:38.463709 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.463692 2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 20 14:06:38.466747 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.466735 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:38.468573 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.468553 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:38.468666 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.468586 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:38.468666 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.468598 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:38.469129 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.469115 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 14:06:38.469179 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.469129 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 14:06:38.469179 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.469147 2555 state_mem.go:36] "Initialized new in-memory state store" May 20 14:06:38.469818 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.469802 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hj7t2" May 20 14:06:38.470147 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.470075 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-178.ec2.internal.18b14b30448ba229 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-178.ec2.internal,UID:ip-10-0-142-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-178.ec2.internal,},FirstTimestamp:2026-05-20 14:06:38.468571689 +0000 UTC m=+0.482122875,LastTimestamp:2026-05-20 14:06:38.468571689 +0000 UTC m=+0.482122875,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-178.ec2.internal,}" May 20 14:06:38.471351 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.471337 2555 policy_none.go:49] "None policy: Start" May 20 14:06:38.471410 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.471354 2555 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 14:06:38.471410 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.471364 2555 state_mem.go:35] "Initializing new in-memory state store" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505158 2555 manager.go:341] "Starting Device Plugin manager" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.505219 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505230 2555 server.go:85] "Starting device plugin registration server" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505493 2555 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505525 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505615 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505694 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.505700 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.506219 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 14:06:38.516665 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.506250 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:38.565778 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.565742 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 14:06:38.567089 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.567073 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 14:06:38.567146 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.567103 2555 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 14:06:38.567146 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.567130 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 14:06:38.567146 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.567137 2555 kubelet.go:2451] "Starting kubelet main sync loop" May 20 14:06:38.567268 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.567182 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 14:06:38.569498 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.569481 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:38.606384 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.606285 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:38.607464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.607449 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:38.607567 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.607478 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:38.607567 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.607488 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:38.607567 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.607531 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-178.ec2.internal" May 20 14:06:38.616095 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.616075 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-178.ec2.internal" May 20 14:06:38.616138 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.616102 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-178.ec2.internal\": node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:38.650548 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.650518 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:38.668064 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.668039 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal"] May 20 14:06:38.668171 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.668118 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:38.669020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.669003 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:38.669100 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.669035 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:38.669100 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.669051 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:38.671391 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.671378 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:38.671554 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.671540 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" May 20 14:06:38.671642 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.671568 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:38.672098 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.672077 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:38.672186 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.672107 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:38.672186 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.672121 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:38.672186 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.672107 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:38.672290 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.672202 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:38.672290 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.672221 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:38.674289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.674274 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.674343 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.674301 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:38.674999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.674979 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:38.675088 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.675016 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:38.675088 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.675031 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:38.697139 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.697113 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-178.ec2.internal\" not found" node="ip-10-0-142-178.ec2.internal" May 20 14:06:38.701857 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.701841 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-178.ec2.internal\" not found" node="ip-10-0-142-178.ec2.internal" May 20 14:06:38.750639 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.750612 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:38.850232 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.850199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f931380657aab6a170cc5bfba4bab08-config\") pod \"kube-apiserver-proxy-ip-10-0-142-178.ec2.internal\" (UID: \"3f931380657aab6a170cc5bfba4bab08\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" May 20 14:06:38.850232 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.850233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96211d7160b9fc63ea92baa3ba18258a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal\" (UID: \"96211d7160b9fc63ea92baa3ba18258a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.850392 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.850272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96211d7160b9fc63ea92baa3ba18258a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal\" (UID: \"96211d7160b9fc63ea92baa3ba18258a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.851192 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.851174 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:38.950911 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.950842 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f931380657aab6a170cc5bfba4bab08-config\") pod \"kube-apiserver-proxy-ip-10-0-142-178.ec2.internal\" (UID: \"3f931380657aab6a170cc5bfba4bab08\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" May 20 14:06:38.950911 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.950883 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96211d7160b9fc63ea92baa3ba18258a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal\" (UID: \"96211d7160b9fc63ea92baa3ba18258a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.950911 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.950899 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96211d7160b9fc63ea92baa3ba18258a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal\" (UID: \"96211d7160b9fc63ea92baa3ba18258a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.951031 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.950935 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96211d7160b9fc63ea92baa3ba18258a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal\" (UID: \"96211d7160b9fc63ea92baa3ba18258a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.951031 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.950942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f931380657aab6a170cc5bfba4bab08-config\") pod \"kube-apiserver-proxy-ip-10-0-142-178.ec2.internal\" (UID: \"3f931380657aab6a170cc5bfba4bab08\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" May 20 14:06:38.951031 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:38.950942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96211d7160b9fc63ea92baa3ba18258a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal\" (UID: \"96211d7160b9fc63ea92baa3ba18258a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:38.951881 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:38.951864 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.000081 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.000059 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" May 20 14:06:39.004758 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.004740 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:39.052531 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.052487 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.152905 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.152880 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.253367 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.253328 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.282901 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.282872 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:39.352081 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.352044 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 14:06:39.352717 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.352202 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 14:06:39.352717 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.352221 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 14:06:39.354209 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.354190 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.448790 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.448760 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 14:06:39.454941 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.454922 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.471763 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.471725 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 14:01:38 +0000 UTC" deadline="2027-12-30 11:00:43.391992645 +0000 UTC" May 20 14:06:39.471763 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.471754 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14132h54m3.920241082s" May 20 14:06:39.485119 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.485088 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 14:06:39.508587 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.508522 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dn5fp" May 20 14:06:39.530559 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.530531 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dn5fp" May 20 14:06:39.555331 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.555302 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.568857 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:39.568808 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96211d7160b9fc63ea92baa3ba18258a.slice/crio-6bfa89e9754cd53d2c860eb00beedfe38c209c02182ba5b136df10cf0f199696 WatchSource:0}: Error finding container 6bfa89e9754cd53d2c860eb00beedfe38c209c02182ba5b136df10cf0f199696: Status 404 returned error can't find the container with id 6bfa89e9754cd53d2c860eb00beedfe38c209c02182ba5b136df10cf0f199696 May 20 14:06:39.569107 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:39.569083 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f931380657aab6a170cc5bfba4bab08.slice/crio-35722d98bc7922d425d4036319a7d35e4b60f39e1aaf07f8285880266adfd176 WatchSource:0}: Error finding container 35722d98bc7922d425d4036319a7d35e4b60f39e1aaf07f8285880266adfd176: Status 404 returned error can't find the container with id 35722d98bc7922d425d4036319a7d35e4b60f39e1aaf07f8285880266adfd176 May 20 14:06:39.573062 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.573044 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:06:39.656395 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.656358 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.756461 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.756420 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.815350 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.815277 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:39.856996 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.856962 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.957662 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:39.957629 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-178.ec2.internal\" not found" May 20 14:06:39.994703 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:39.994673 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:40.049427 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.049394 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" May 20 14:06:40.063462 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.063436 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 14:06:40.064360 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.064344 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" May 20 14:06:40.077850 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.077790 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 14:06:40.428282 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.428209 2555 apiserver.go:52] "Watching apiserver" May 20 14:06:40.436084 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.436053 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 14:06:40.438238 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.438213 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rsvdz","openshift-image-registry/node-ca-pnxgt","openshift-multus/multus-7qjsz","openshift-multus/multus-additional-cni-plugins-tq89j","openshift-multus/network-metrics-daemon-rxsxj","openshift-cluster-node-tuning-operator/tuned-f8djr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal","openshift-network-diagnostics/network-check-target-7f65r","openshift-network-operator/iptables-alerter-slpxn","openshift-ovn-kubernetes/ovnkube-node-9nrmg","kube-system/konnectivity-agent-4pkds","kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k"] May 20 14:06:40.442770 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.442743 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.444800 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.444781 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.445707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.445663 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mcch2\"" May 20 14:06:40.445707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.445673 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 14:06:40.445707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.445680 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 14:06:40.446992 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.446963 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7qjsz" May 20 14:06:40.447083 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.447067 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.447260 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.447238 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 14:06:40.447352 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.447296 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jcgjx\"" May 20 14:06:40.447595 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.447570 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 14:06:40.447695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.447644 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 14:06:40.449525 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.449248 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:40.449525 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.449327 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:40.451460 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.451437 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.452574 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.452547 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 14:06:40.452720 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.452701 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 14:06:40.452806 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.452748 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pwldq\"" May 20 14:06:40.453007 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.452987 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 14:06:40.453084 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.453015 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 14:06:40.453084 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.452988 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 14:06:40.453761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.453741 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.455992 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.455972 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:40.456082 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.456048 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459603 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459622 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6dkrb\"" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459876 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b9vcg\"" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-modprobe-d\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459956 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-run\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.459990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-tuned\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwb7\" (UniqueName: \"kubernetes.io/projected/b85667f9-8b25-43fb-9421-b49a72c199f7-kube-api-access-tzwb7\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460080 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-conf-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460246 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfdfp\" (UniqueName: \"kubernetes.io/projected/3a2bf97b-1e34-48d4-b216-e624c83db7d9-kube-api-access-bfdfp\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysconfig\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460380 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysctl-conf\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460394 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-var-lib-kubelet\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460432 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-cnibin\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b94e2ce1-cf19-421d-958b-f3f35ac7627f-cni-binary-copy\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-netns\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd9d8\" (UniqueName: \"kubernetes.io/projected/2cd0dd56-cecd-4f98-a24d-5f18754736d3-kube-api-access-nd9d8\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/432fca58-c6aa-4cab-ba73-2ba20c9e2e18-konnectivity-ca\") pod \"konnectivity-agent-4pkds\" (UID: \"432fca58-c6aa-4cab-ba73-2ba20c9e2e18\") " pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8674ca5b-4b88-422c-9b77-50fb73dfef07-serviceca\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-socket-dir-parent\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.460794 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysctl-d\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/432fca58-c6aa-4cab-ba73-2ba20c9e2e18-agent-certs\") pod \"konnectivity-agent-4pkds\" (UID: \"432fca58-c6aa-4cab-ba73-2ba20c9e2e18\") " pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460930 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-cni-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.460991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-kubelet\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-etc-kubernetes\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-kubernetes\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-systemd\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.461162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461139 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-os-release\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-hostroot\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-daemon-config\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cnibin\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-sys\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-system-cni-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-multus-certs\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461546 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-system-cni-dir\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.461892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461569 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-host\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.461892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45p9j\" (UniqueName: \"kubernetes.io/projected/8674ca5b-4b88-422c-9b77-50fb73dfef07-kube-api-access-45p9j\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.461892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461641 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-cni-bin\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461678 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-cni-multus\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdtj9\" (UniqueName: \"kubernetes.io/projected/b94e2ce1-cf19-421d-958b-f3f35ac7627f-kube-api-access-tdtj9\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.461892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461813 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-os-release\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.462163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-lib-modules\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.462163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461979 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.462163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462011 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.462163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462083 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 14:06:40.462163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462120 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 14:06:40.462378 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462221 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f4qp9\"" May 20 14:06:40.462378 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.461981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85667f9-8b25-43fb-9421-b49a72c199f7-tmp\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.462378 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462290 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 14:06:40.462378 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8674ca5b-4b88-422c-9b77-50fb73dfef07-host\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.462378 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.462340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-k8s-cni-cncf-io\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.464817 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.464799 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.465515 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.465480 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-plkpn\"" May 20 14:06:40.465621 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.465546 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 14:06:40.465621 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.465482 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 14:06:40.465821 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.465480 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 14:06:40.466312 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.466189 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84h5q\"" May 20 14:06:40.466312 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.466221 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 14:06:40.466312 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.466280 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 14:06:40.466908 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.466891 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4r4f2\"" May 20 14:06:40.467560 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.467542 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 14:06:40.468694 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.468543 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 14:06:40.468694 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.468560 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 14:06:40.468694 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.468601 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 14:06:40.468694 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.468615 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 14:06:40.468694 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.468561 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 14:06:40.531439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.531396 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 14:01:39 +0000 UTC" deadline="2028-02-26 17:50:00.890234292 +0000 UTC" May 20 14:06:40.531439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.531432 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15531h43m20.358805831s" May 20 14:06:40.549562 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.549533 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 14:06:40.563570 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563537 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-cni-multus\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.563761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-ovnkube-config\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.563761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563625 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85667f9-8b25-43fb-9421-b49a72c199f7-tmp\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.563761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563651 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-k8s-cni-cncf-io\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.563761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-cni-multus\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.563761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563685 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-ovn\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.563761 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563731 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-modprobe-d\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563769 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-k8s-cni-cncf-io\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-run\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563865 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-registration-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwg46\" (UniqueName: \"kubernetes.io/projected/2c84e303-6cfb-4abc-9982-c5266d725932-kube-api-access-pwg46\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-modprobe-d\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563924 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-run\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-slash\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.564020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.563985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-log-socket\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-cni-bin\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-ovnkube-script-lib\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564076 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfdfp\" (UniqueName: \"kubernetes.io/projected/3a2bf97b-1e34-48d4-b216-e624c83db7d9-kube-api-access-bfdfp\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564093 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysconfig\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564109 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-var-lib-kubelet\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564145 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-cnibin\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564156 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysconfig\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564162 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b94e2ce1-cf19-421d-958b-f3f35ac7627f-cni-binary-copy\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564196 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-netns\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564200 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-var-lib-kubelet\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-node-log\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564236 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-cnibin\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564270 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhpd\" (UniqueName: \"kubernetes.io/projected/727cfc25-9233-4c78-aff7-ab457355d6bd-kube-api-access-7nhpd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.564336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564298 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-netns\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564759 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8674ca5b-4b88-422c-9b77-50fb73dfef07-serviceca\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564351 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8674ca5b-4b88-422c-9b77-50fb73dfef07-serviceca\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564861 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b94e2ce1-cf19-421d-958b-f3f35ac7627f-cni-binary-copy\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564869 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-socket-dir-parent\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-run-netns\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564920 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-socket-dir-parent\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-var-lib-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.564961 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565029 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysctl-d\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565056 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-kubelet\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565093 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565080 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-etc-kubernetes\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrnk\" (UniqueName: \"kubernetes.io/projected/5fd33346-cf67-4b07-9057-dc6075a620c7-kube-api-access-fmrnk\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565141 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-kubelet\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565190 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-daemon-config\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565208 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysctl-d\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57cb13d6-02b3-401e-a361-ff3337498297-iptables-alerter-script\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-etc-kubernetes\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565315 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-sys\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565342 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-systemd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-env-overrides\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/727cfc25-9233-4c78-aff7-ab457355d6bd-ovn-node-metrics-cert\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565440 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-sys\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565520 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-cni-bin\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565554 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdtj9\" (UniqueName: \"kubernetes.io/projected/b94e2ce1-cf19-421d-958b-f3f35ac7627f-kube-api-access-tdtj9\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.565617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565580 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-var-lib-cni-bin\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565582 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-socket-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565625 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-daemon-config\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-systemd-units\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565777 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-os-release\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565817 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-lib-modules\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565852 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8674ca5b-4b88-422c-9b77-50fb73dfef07-host\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565864 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-os-release\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fd33346-cf67-4b07-9057-dc6075a620c7-hosts-file\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-sys-fs\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565951 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8674ca5b-4b88-422c-9b77-50fb73dfef07-host\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565976 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.565989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-lib-modules\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-tuned\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566059 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwb7\" (UniqueName: \"kubernetes.io/projected/b85667f9-8b25-43fb-9421-b49a72c199f7-kube-api-access-tzwb7\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566085 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-conf-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.566364 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.566110 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.566182 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:41.066152476 +0000 UTC m=+3.079703677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-device-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566279 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-etc-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566307 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566334 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysctl-conf\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566388 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd9d8\" (UniqueName: \"kubernetes.io/projected/2cd0dd56-cecd-4f98-a24d-5f18754736d3-kube-api-access-nd9d8\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-conf-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566416 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/432fca58-c6aa-4cab-ba73-2ba20c9e2e18-konnectivity-ca\") pod \"konnectivity-agent-4pkds\" (UID: \"432fca58-c6aa-4cab-ba73-2ba20c9e2e18\") " pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-kubelet\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566473 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-sysctl-conf\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566497 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566546 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/432fca58-c6aa-4cab-ba73-2ba20c9e2e18-agent-certs\") pod \"konnectivity-agent-4pkds\" (UID: \"432fca58-c6aa-4cab-ba73-2ba20c9e2e18\") " pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566573 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-cni-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.567156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fd33346-cf67-4b07-9057-dc6075a620c7-tmp-dir\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566623 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-etc-selinux\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57cb13d6-02b3-401e-a361-ff3337498297-host-slash\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566700 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlf79\" (UniqueName: \"kubernetes.io/projected/57cb13d6-02b3-401e-a361-ff3337498297-kube-api-access-tlf79\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566738 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-cni-netd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566766 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-kubernetes\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566797 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566815 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-systemd\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566907 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-os-release\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566938 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-hostroot\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566966 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cnibin\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-systemd\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566991 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567017 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-system-cni-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567042 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-multus-certs\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567068 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-system-cni-dir\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567092 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-host\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.567929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567116 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45p9j\" (UniqueName: \"kubernetes.io/projected/8674ca5b-4b88-422c-9b77-50fb73dfef07-kube-api-access-45p9j\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.566893 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-multus-cni-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567449 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/432fca58-c6aa-4cab-ba73-2ba20c9e2e18-konnectivity-ca\") pod \"konnectivity-agent-4pkds\" (UID: \"432fca58-c6aa-4cab-ba73-2ba20c9e2e18\") " pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567538 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-kubernetes\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567453 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-os-release\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567590 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-hostroot\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-host-run-multus-certs\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-system-cni-dir\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567688 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-cnibin\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b94e2ce1-cf19-421d-958b-f3f35ac7627f-system-cni-dir\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2bf97b-1e34-48d4-b216-e624c83db7d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.567771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b85667f9-8b25-43fb-9421-b49a72c199f7-host\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.568242 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85667f9-8b25-43fb-9421-b49a72c199f7-tmp\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.568463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b85667f9-8b25-43fb-9421-b49a72c199f7-etc-tuned\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.568715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.568461 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a2bf97b-1e34-48d4-b216-e624c83db7d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.573046 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.570887 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/432fca58-c6aa-4cab-ba73-2ba20c9e2e18-agent-certs\") pod \"konnectivity-agent-4pkds\" (UID: \"432fca58-c6aa-4cab-ba73-2ba20c9e2e18\") " pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.576240 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.576143 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" event={"ID":"3f931380657aab6a170cc5bfba4bab08","Type":"ContainerStarted","Data":"35722d98bc7922d425d4036319a7d35e4b60f39e1aaf07f8285880266adfd176"} May 20 14:06:40.577300 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.577275 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" event={"ID":"96211d7160b9fc63ea92baa3ba18258a","Type":"ContainerStarted","Data":"6bfa89e9754cd53d2c860eb00beedfe38c209c02182ba5b136df10cf0f199696"} May 20 14:06:40.578304 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.578285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdtj9\" (UniqueName: \"kubernetes.io/projected/b94e2ce1-cf19-421d-958b-f3f35ac7627f-kube-api-access-tdtj9\") pod \"multus-7qjsz\" (UID: \"b94e2ce1-cf19-421d-958b-f3f35ac7627f\") " pod="openshift-multus/multus-7qjsz" May 20 14:06:40.578820 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.578801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfdfp\" (UniqueName: \"kubernetes.io/projected/3a2bf97b-1e34-48d4-b216-e624c83db7d9-kube-api-access-bfdfp\") pod \"multus-additional-cni-plugins-tq89j\" (UID: \"3a2bf97b-1e34-48d4-b216-e624c83db7d9\") " pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.581410 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.581383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd9d8\" (UniqueName: \"kubernetes.io/projected/2cd0dd56-cecd-4f98-a24d-5f18754736d3-kube-api-access-nd9d8\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:40.581617 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.581599 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwb7\" (UniqueName: \"kubernetes.io/projected/b85667f9-8b25-43fb-9421-b49a72c199f7-kube-api-access-tzwb7\") pod \"tuned-f8djr\" (UID: \"b85667f9-8b25-43fb-9421-b49a72c199f7\") " pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.581956 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.581940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45p9j\" (UniqueName: \"kubernetes.io/projected/8674ca5b-4b88-422c-9b77-50fb73dfef07-kube-api-access-45p9j\") pod \"node-ca-pnxgt\" (UID: \"8674ca5b-4b88-422c-9b77-50fb73dfef07\") " pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.630133 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.630096 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:40.668095 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668062 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-ovn\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668095 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668102 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-registration-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668129 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwg46\" (UniqueName: \"kubernetes.io/projected/2c84e303-6cfb-4abc-9982-c5266d725932-kube-api-access-pwg46\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-ovn\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668200 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-registration-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668241 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-slash\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668269 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-log-socket\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668295 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-cni-bin\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668323 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-ovnkube-script-lib\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668353 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-node-log\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668378 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhpd\" (UniqueName: \"kubernetes.io/projected/727cfc25-9233-4c78-aff7-ab457355d6bd-kube-api-access-7nhpd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668392 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-log-socket\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668405 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-run-netns\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-slash\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668433 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-var-lib-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668464 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrnk\" (UniqueName: \"kubernetes.io/projected/5fd33346-cf67-4b07-9057-dc6075a620c7-kube-api-access-fmrnk\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668493 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-run-netns\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-var-lib-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-node-log\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668621 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668656 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57cb13d6-02b3-401e-a361-ff3337498297-iptables-alerter-script\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668657 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-cni-bin\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.668695 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668683 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668724 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668740 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-systemd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668770 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-env-overrides\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668796 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/727cfc25-9233-4c78-aff7-ab457355d6bd-ovn-node-metrics-cert\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-systemd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668822 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-socket-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668945 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-systemd-units\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.668977 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669006 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fd33346-cf67-4b07-9057-dc6075a620c7-hosts-file\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669032 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-sys-fs\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669038 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-run-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669072 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-device-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669077 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-systemd-units\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669003 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-socket-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669097 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-etc-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669124 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669152 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669160 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-ovnkube-script-lib\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669178 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-kubelet\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669208 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fd33346-cf67-4b07-9057-dc6075a620c7-hosts-file\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669213 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-etc-openvswitch\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57cb13d6-02b3-401e-a361-ff3337498297-iptables-alerter-script\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669261 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-kubelet\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-device-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-sys-fs\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-env-overrides\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669315 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669421 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fd33346-cf67-4b07-9057-dc6075a620c7-tmp-dir\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669447 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-etc-selinux\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669463 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57cb13d6-02b3-401e-a361-ff3337498297-host-slash\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669478 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlf79\" (UniqueName: \"kubernetes.io/projected/57cb13d6-02b3-401e-a361-ff3337498297-kube-api-access-tlf79\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669498 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-cni-netd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.669999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669532 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57cb13d6-02b3-401e-a361-ff3337498297-host-slash\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.670532 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669538 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-ovnkube-config\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.670532 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c84e303-6cfb-4abc-9982-c5266d725932-etc-selinux\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.670532 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669626 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/727cfc25-9233-4c78-aff7-ab457355d6bd-host-cni-netd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.670532 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669746 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fd33346-cf67-4b07-9057-dc6075a620c7-tmp-dir\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.670532 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.669891 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/727cfc25-9233-4c78-aff7-ab457355d6bd-ovnkube-config\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.671082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.671068 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/727cfc25-9233-4c78-aff7-ab457355d6bd-ovn-node-metrics-cert\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.677978 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.677950 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:40.677978 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.677978 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:40.678172 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.677989 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:40.678172 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:40.678065 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:41.17804642 +0000 UTC m=+3.191597616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:40.680473 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.680419 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwg46\" (UniqueName: \"kubernetes.io/projected/2c84e303-6cfb-4abc-9982-c5266d725932-kube-api-access-pwg46\") pod \"aws-ebs-csi-driver-node-phq9k\" (UID: \"2c84e303-6cfb-4abc-9982-c5266d725932\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.680473 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.680436 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrnk\" (UniqueName: \"kubernetes.io/projected/5fd33346-cf67-4b07-9057-dc6075a620c7-kube-api-access-fmrnk\") pod \"node-resolver-rsvdz\" (UID: \"5fd33346-cf67-4b07-9057-dc6075a620c7\") " pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.680939 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.680918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhpd\" (UniqueName: \"kubernetes.io/projected/727cfc25-9233-4c78-aff7-ab457355d6bd-kube-api-access-7nhpd\") pod \"ovnkube-node-9nrmg\" (UID: \"727cfc25-9233-4c78-aff7-ab457355d6bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:40.681435 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.681412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlf79\" (UniqueName: \"kubernetes.io/projected/57cb13d6-02b3-401e-a361-ff3337498297-kube-api-access-tlf79\") pod \"iptables-alerter-slpxn\" (UID: \"57cb13d6-02b3-401e-a361-ff3337498297\") " pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.754495 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.754462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:40.762309 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.762276 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pnxgt" May 20 14:06:40.771084 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.771056 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7qjsz" May 20 14:06:40.777682 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.777655 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tq89j" May 20 14:06:40.783390 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.783359 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f8djr" May 20 14:06:40.790157 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.790128 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" May 20 14:06:40.796763 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.796738 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsvdz" May 20 14:06:40.805427 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.805401 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-slpxn" May 20 14:06:40.810191 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:40.810164 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:06:41.071478 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.071443 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:41.071681 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.071650 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:41.071734 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.071726 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:42.071707368 +0000 UTC m=+4.085258544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:41.134729 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.134693 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727cfc25_9233_4c78_aff7_ab457355d6bd.slice/crio-5dbc9b64e0c19637d6cc239b7e045866d9eafa35ac96244b38cf5092199ee8c6 WatchSource:0}: Error finding container 5dbc9b64e0c19637d6cc239b7e045866d9eafa35ac96244b38cf5092199ee8c6: Status 404 returned error can't find the container with id 5dbc9b64e0c19637d6cc239b7e045866d9eafa35ac96244b38cf5092199ee8c6 May 20 14:06:41.135697 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.135662 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2bf97b_1e34_48d4_b216_e624c83db7d9.slice/crio-d493dae5e7da3cf0c36f3417e1df835e929305e427124ecef126729e26040ec3 WatchSource:0}: Error finding container d493dae5e7da3cf0c36f3417e1df835e929305e427124ecef126729e26040ec3: Status 404 returned error can't find the container with id d493dae5e7da3cf0c36f3417e1df835e929305e427124ecef126729e26040ec3 May 20 14:06:41.136725 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.136699 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8674ca5b_4b88_422c_9b77_50fb73dfef07.slice/crio-8573ba4bb248fb5e8c6e9b61d1c31581cc9ac02f43d35638e414ee10ef435ae6 WatchSource:0}: Error finding container 8573ba4bb248fb5e8c6e9b61d1c31581cc9ac02f43d35638e414ee10ef435ae6: Status 404 returned error can't find the container with id 8573ba4bb248fb5e8c6e9b61d1c31581cc9ac02f43d35638e414ee10ef435ae6 May 20 14:06:41.137770 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.137338 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85667f9_8b25_43fb_9421_b49a72c199f7.slice/crio-d3130444fb706a83c96b84762bd49c5f7b4aec8138adff456459e35fe54ed329 WatchSource:0}: Error finding container d3130444fb706a83c96b84762bd49c5f7b4aec8138adff456459e35fe54ed329: Status 404 returned error can't find the container with id d3130444fb706a83c96b84762bd49c5f7b4aec8138adff456459e35fe54ed329 May 20 14:06:41.138328 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.138299 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd33346_cf67_4b07_9057_dc6075a620c7.slice/crio-f96264019330363d75bea29fc933d6b3d514942cbba7a86325f1b8eb243f4240 WatchSource:0}: Error finding container f96264019330363d75bea29fc933d6b3d514942cbba7a86325f1b8eb243f4240: Status 404 returned error can't find the container with id f96264019330363d75bea29fc933d6b3d514942cbba7a86325f1b8eb243f4240 May 20 14:06:41.141044 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.141020 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c84e303_6cfb_4abc_9982_c5266d725932.slice/crio-8fde006608b92adc375a5fb6b9666eed5a9e529b19c23f2101f42e788785a691 WatchSource:0}: Error finding container 8fde006608b92adc375a5fb6b9666eed5a9e529b19c23f2101f42e788785a691: Status 404 returned error can't find the container with id 8fde006608b92adc375a5fb6b9666eed5a9e529b19c23f2101f42e788785a691 May 20 14:06:41.164256 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.164220 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cb13d6_02b3_401e_a361_ff3337498297.slice/crio-788c80246a6c638ae996047894e241489bcc828cd0764af3bf84b3462a61ed38 WatchSource:0}: Error finding container 788c80246a6c638ae996047894e241489bcc828cd0764af3bf84b3462a61ed38: Status 404 returned error can't find the container with id 788c80246a6c638ae996047894e241489bcc828cd0764af3bf84b3462a61ed38 May 20 14:06:41.165026 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.164975 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432fca58_c6aa_4cab_ba73_2ba20c9e2e18.slice/crio-488bd1e4bd5f33c49c0b8d6a213106f09c414343b1218845f20787ec44680217 WatchSource:0}: Error finding container 488bd1e4bd5f33c49c0b8d6a213106f09c414343b1218845f20787ec44680217: Status 404 returned error can't find the container with id 488bd1e4bd5f33c49c0b8d6a213106f09c414343b1218845f20787ec44680217 May 20 14:06:41.166359 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:06:41.166337 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94e2ce1_cf19_421d_958b_f3f35ac7627f.slice/crio-ee099c2ef8da2213164e490994bbfb91194d17f6959741e8138f26309da6ed48 WatchSource:0}: Error finding container ee099c2ef8da2213164e490994bbfb91194d17f6959741e8138f26309da6ed48: Status 404 returned error can't find the container with id ee099c2ef8da2213164e490994bbfb91194d17f6959741e8138f26309da6ed48 May 20 14:06:41.273928 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.273712 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:41.274060 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.273869 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:41.274060 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.274035 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:41.274060 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.274055 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:41.274182 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.274116 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:42.274101049 +0000 UTC m=+4.287652223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:41.532216 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.532168 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 14:01:39 +0000 UTC" deadline="2028-01-29 02:17:00.510928938 +0000 UTC" May 20 14:06:41.532216 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.532212 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14844h10m18.978721196s" May 20 14:06:41.567705 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.567669 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:41.567875 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:41.567802 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:41.594372 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.593715 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" event={"ID":"3f931380657aab6a170cc5bfba4bab08","Type":"ContainerStarted","Data":"efc4f7e156c4bcbd2721fc64f2fc80f857adf312a909e0882c2b909633c65117"} May 20 14:06:41.606314 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.604033 2555 generic.go:358] "Generic (PLEG): container finished" podID="96211d7160b9fc63ea92baa3ba18258a" containerID="ab45c8a35cef078af38d213a35d3cb20ef537cfcf5b6eee79ff4d26c70ea53d9" exitCode=0 May 20 14:06:41.606314 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.604110 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" event={"ID":"96211d7160b9fc63ea92baa3ba18258a","Type":"ContainerDied","Data":"ab45c8a35cef078af38d213a35d3cb20ef537cfcf5b6eee79ff4d26c70ea53d9"} May 20 14:06:41.609747 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.609701 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4pkds" event={"ID":"432fca58-c6aa-4cab-ba73-2ba20c9e2e18","Type":"ContainerStarted","Data":"488bd1e4bd5f33c49c0b8d6a213106f09c414343b1218845f20787ec44680217"} May 20 14:06:41.611729 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.611676 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-178.ec2.internal" podStartSLOduration=1.6116602549999999 podStartE2EDuration="1.611660255s" podCreationTimestamp="2026-05-20 14:06:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:06:41.611092262 +0000 UTC m=+3.624643475" watchObservedRunningTime="2026-05-20 14:06:41.611660255 +0000 UTC m=+3.625211451" May 20 14:06:41.613052 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.612974 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" event={"ID":"2c84e303-6cfb-4abc-9982-c5266d725932","Type":"ContainerStarted","Data":"8fde006608b92adc375a5fb6b9666eed5a9e529b19c23f2101f42e788785a691"} May 20 14:06:41.617247 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.616754 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsvdz" event={"ID":"5fd33346-cf67-4b07-9057-dc6075a620c7","Type":"ContainerStarted","Data":"f96264019330363d75bea29fc933d6b3d514942cbba7a86325f1b8eb243f4240"} May 20 14:06:41.621074 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.621015 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f8djr" event={"ID":"b85667f9-8b25-43fb-9421-b49a72c199f7","Type":"ContainerStarted","Data":"d3130444fb706a83c96b84762bd49c5f7b4aec8138adff456459e35fe54ed329"} May 20 14:06:41.625374 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.625347 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerStarted","Data":"d493dae5e7da3cf0c36f3417e1df835e929305e427124ecef126729e26040ec3"} May 20 14:06:41.633408 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.633374 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"5dbc9b64e0c19637d6cc239b7e045866d9eafa35ac96244b38cf5092199ee8c6"} May 20 14:06:41.638464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.637676 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-slpxn" event={"ID":"57cb13d6-02b3-401e-a361-ff3337498297","Type":"ContainerStarted","Data":"788c80246a6c638ae996047894e241489bcc828cd0764af3bf84b3462a61ed38"} May 20 14:06:41.644728 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.644695 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7qjsz" event={"ID":"b94e2ce1-cf19-421d-958b-f3f35ac7627f","Type":"ContainerStarted","Data":"ee099c2ef8da2213164e490994bbfb91194d17f6959741e8138f26309da6ed48"} May 20 14:06:41.648026 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.647995 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pnxgt" event={"ID":"8674ca5b-4b88-422c-9b77-50fb73dfef07","Type":"ContainerStarted","Data":"8573ba4bb248fb5e8c6e9b61d1c31581cc9ac02f43d35638e414ee10ef435ae6"} May 20 14:06:41.832015 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:41.831967 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:42.080083 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:42.079930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:42.080256 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.080119 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:42.080256 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.080181 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:44.080163815 +0000 UTC m=+6.093714988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:42.282143 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:42.282082 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:42.282309 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.282246 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:42.282309 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.282266 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:42.282309 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.282279 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:42.282480 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.282337 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:44.282319246 +0000 UTC m=+6.295870423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:42.570663 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:42.570633 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:42.571225 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:42.570758 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:42.666944 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:42.666854 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" event={"ID":"96211d7160b9fc63ea92baa3ba18258a","Type":"ContainerStarted","Data":"dd45db4d8664e69992d3d434778e221b40cab556d700d3f4c563ec9ee0bb2eb7"} May 20 14:06:43.567545 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:43.567496 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:43.567732 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:43.567666 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:44.095087 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:44.095023 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:44.095583 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.095195 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:44.095583 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.095259 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:48.095240453 +0000 UTC m=+10.108791641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:44.297143 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:44.296572 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:44.297143 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.296901 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:44.297143 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.296922 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:44.297143 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.296935 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:44.297143 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.297004 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:48.296984799 +0000 UTC m=+10.310535973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:44.567813 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:44.567780 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:44.567995 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:44.567911 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:45.568025 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.567973 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:45.568451 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:45.568106 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:45.586577 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.586527 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-178.ec2.internal" podStartSLOduration=5.586496886 podStartE2EDuration="5.586496886s" podCreationTimestamp="2026-05-20 14:06:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:06:42.685093031 +0000 UTC m=+4.698644228" watchObservedRunningTime="2026-05-20 14:06:45.586496886 +0000 UTC m=+7.600048083" May 20 14:06:45.586749 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.586661 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fl7sz"] May 20 14:06:45.589759 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.589737 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.589882 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:45.589811 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:45.709275 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.709149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.709275 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.709198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-kubelet-config\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.709536 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.709295 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-dbus\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.809834 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.809892 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-kubelet-config\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.809963 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-dbus\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:45.810030 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:45.810106 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret podName:df54abc0-d4ac-4103-94f7-94df3d3dc8f4 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:46.310084863 +0000 UTC m=+8.323636055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret") pod "global-pull-secret-syncer-fl7sz" (UID: "df54abc0-d4ac-4103-94f7-94df3d3dc8f4") : object "kube-system"/"original-pull-secret" not registered May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.810193 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-dbus\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:45.810310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:45.810258 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-kubelet-config\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:46.314139 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:46.314099 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:46.314303 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:46.314290 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:06:46.314362 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:46.314357 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret podName:df54abc0-d4ac-4103-94f7-94df3d3dc8f4 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:47.314337206 +0000 UTC m=+9.327888384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret") pod "global-pull-secret-syncer-fl7sz" (UID: "df54abc0-d4ac-4103-94f7-94df3d3dc8f4") : object "kube-system"/"original-pull-secret" not registered May 20 14:06:46.567962 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:46.567885 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:46.568124 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:46.568026 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:47.323317 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:47.323275 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:47.323491 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:47.323444 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:06:47.323602 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:47.323536 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret podName:df54abc0-d4ac-4103-94f7-94df3d3dc8f4 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:49.323516036 +0000 UTC m=+11.337067223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret") pod "global-pull-secret-syncer-fl7sz" (UID: "df54abc0-d4ac-4103-94f7-94df3d3dc8f4") : object "kube-system"/"original-pull-secret" not registered May 20 14:06:47.567661 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:47.567619 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:47.567846 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:47.567765 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:47.567846 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:47.567779 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:47.567956 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:47.567900 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:48.129961 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:48.129357 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:48.129961 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.129548 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:48.129961 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.129608 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:56.129590758 +0000 UTC m=+18.143141933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:48.331118 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:48.330989 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:48.331282 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.331180 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:48.331282 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.331199 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:48.331282 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.331210 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:48.331282 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.331267 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:56.331250355 +0000 UTC m=+18.344801543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:48.569007 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:48.568971 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:48.569175 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:48.569100 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:49.339771 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:49.339679 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:49.340228 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:49.339815 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:06:49.340228 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:49.339883 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret podName:df54abc0-d4ac-4103-94f7-94df3d3dc8f4 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:53.3398649 +0000 UTC m=+15.353416079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret") pod "global-pull-secret-syncer-fl7sz" (UID: "df54abc0-d4ac-4103-94f7-94df3d3dc8f4") : object "kube-system"/"original-pull-secret" not registered May 20 14:06:49.567488 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:49.567454 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:49.567659 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:49.567454 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:49.567659 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:49.567616 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:49.567769 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:49.567717 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:50.567738 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:50.567703 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:50.568106 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:50.567830 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:51.568334 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:51.568304 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:51.568762 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:51.568301 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:51.568762 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:51.568460 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:51.568762 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:51.568547 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:52.567591 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:52.567542 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:52.567833 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:52.567690 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:53.367910 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:53.367869 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:53.368359 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:53.368005 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:06:53.368359 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:53.368077 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret podName:df54abc0-d4ac-4103-94f7-94df3d3dc8f4 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:01.368055383 +0000 UTC m=+23.381606561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret") pod "global-pull-secret-syncer-fl7sz" (UID: "df54abc0-d4ac-4103-94f7-94df3d3dc8f4") : object "kube-system"/"original-pull-secret" not registered May 20 14:06:53.568240 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:53.568199 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:53.568390 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:53.568256 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:53.568390 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:53.568378 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:53.568549 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:53.568518 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:54.567749 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:54.567713 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:54.568249 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:54.567845 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:55.567323 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:55.567292 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:55.567323 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:55.567312 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:55.567794 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:55.567408 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:55.567794 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:55.567568 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:56.191064 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:56.191022 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:56.191240 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.191187 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:56.191312 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.191264 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:12.191246091 +0000 UTC m=+34.204797268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:56.392779 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:56.392740 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:56.392933 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.392866 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:56.392933 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.392883 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:56.392933 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.392894 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:56.393098 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.392962 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:12.392940595 +0000 UTC m=+34.406491781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:56.567950 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:56.567909 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:56.568362 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:56.568039 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:57.567950 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:57.567919 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:57.568121 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:57.567920 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:57.568121 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:57.568047 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:57.568467 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:57.568119 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:58.568650 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:58.568623 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:06:58.569041 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:58.568724 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:06:59.567910 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.567744 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:06:59.568017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.567744 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:06:59.568085 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:59.568054 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:06:59.568171 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:06:59.568154 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:06:59.697822 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.697797 2555 generic.go:358] "Generic (PLEG): container finished" podID="3a2bf97b-1e34-48d4-b216-e624c83db7d9" containerID="fd96122a1f975c713a84e7b9c75827389cf19dca6744112973b5c8e2105063f1" exitCode=0 May 20 14:06:59.698420 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.697862 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerDied","Data":"fd96122a1f975c713a84e7b9c75827389cf19dca6744112973b5c8e2105063f1"} May 20 14:06:59.699460 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.699446 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:06:59.699825 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.699799 2555 generic.go:358] "Generic (PLEG): container finished" podID="727cfc25-9233-4c78-aff7-ab457355d6bd" containerID="e514338e67dec30cd602bb18f9f711e9de33e7bd2d1427e98aad9c2a248823e7" exitCode=1 May 20 14:06:59.699883 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.699863 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"9dc86a24a47f89c7f7891740b0f6bb2411c5faad9f66039d8684d60dd174663e"} May 20 14:06:59.699923 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.699896 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerDied","Data":"e514338e67dec30cd602bb18f9f711e9de33e7bd2d1427e98aad9c2a248823e7"} May 20 14:06:59.699923 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.699915 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"3383fa3e31bd47c7983a8c2e2ab015b7a074582e8e6eee92d54264eebcfc7b5c"} May 20 14:06:59.701126 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.701105 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7qjsz" event={"ID":"b94e2ce1-cf19-421d-958b-f3f35ac7627f","Type":"ContainerStarted","Data":"8ccadd903db88cdd204eefccaf1bd30f79f8cfb3a5a781ae0dc46cbe57ec4b07"} May 20 14:06:59.702324 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.702305 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pnxgt" event={"ID":"8674ca5b-4b88-422c-9b77-50fb73dfef07","Type":"ContainerStarted","Data":"5ea18a18f049b1e3a28c95fdfce47da8a4e962e5b9a08133917a5b76d16d84d9"} May 20 14:06:59.703532 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.703498 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4pkds" event={"ID":"432fca58-c6aa-4cab-ba73-2ba20c9e2e18","Type":"ContainerStarted","Data":"b8799354fd2db01b94e628d243cb27399c4067238d5d6b3ec001f2d3ad2a3ac9"} May 20 14:06:59.705350 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.705330 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" event={"ID":"2c84e303-6cfb-4abc-9982-c5266d725932","Type":"ContainerStarted","Data":"a4f4200c2c6ef10eecdb1cac90564470499dfec77efce109ae8c838f22539b39"} May 20 14:06:59.706353 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.706332 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsvdz" event={"ID":"5fd33346-cf67-4b07-9057-dc6075a620c7","Type":"ContainerStarted","Data":"7956f8170dc2a65ff684f7d921dcf45dabb641f342ac65fb0983ec23352bd540"} May 20 14:06:59.707358 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.707341 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f8djr" event={"ID":"b85667f9-8b25-43fb-9421-b49a72c199f7","Type":"ContainerStarted","Data":"9247b51660516be4724f9c36c1289383ddc9e0276bdc63b50b9c961cddf20256"} May 20 14:06:59.739430 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.739262 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7qjsz" podStartSLOduration=3.6596554169999997 podStartE2EDuration="21.739249607s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.168597125 +0000 UTC m=+3.182148298" lastFinishedPulling="2026-05-20 14:06:59.248191301 +0000 UTC m=+21.261742488" observedRunningTime="2026-05-20 14:06:59.739096276 +0000 UTC m=+21.752647470" watchObservedRunningTime="2026-05-20 14:06:59.739249607 +0000 UTC m=+21.752800802" May 20 14:06:59.757539 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.757473 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f8djr" podStartSLOduration=3.693498997 podStartE2EDuration="21.757457306s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.139460011 +0000 UTC m=+3.153011197" lastFinishedPulling="2026-05-20 14:06:59.203418318 +0000 UTC m=+21.216969506" observedRunningTime="2026-05-20 14:06:59.757355934 +0000 UTC m=+21.770907130" watchObservedRunningTime="2026-05-20 14:06:59.757457306 +0000 UTC m=+21.771008502" May 20 14:06:59.774412 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.774358 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rsvdz" podStartSLOduration=3.713756972 podStartE2EDuration="21.774343394s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.140313122 +0000 UTC m=+3.153864308" lastFinishedPulling="2026-05-20 14:06:59.200899552 +0000 UTC m=+21.214450730" observedRunningTime="2026-05-20 14:06:59.774274437 +0000 UTC m=+21.787825632" watchObservedRunningTime="2026-05-20 14:06:59.774343394 +0000 UTC m=+21.787894589" May 20 14:06:59.793065 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.793025 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4pkds" podStartSLOduration=3.7832589949999997 podStartE2EDuration="21.793009697s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.168531514 +0000 UTC m=+3.182082700" lastFinishedPulling="2026-05-20 14:06:59.178282228 +0000 UTC m=+21.191833402" observedRunningTime="2026-05-20 14:06:59.792697573 +0000 UTC m=+21.806248771" watchObservedRunningTime="2026-05-20 14:06:59.793009697 +0000 UTC m=+21.806560892" May 20 14:06:59.968163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.968133 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4pkds" May 20 14:06:59.968809 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:06:59.968792 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4pkds" May 20 14:07:00.000422 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.000373 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pnxgt" podStartSLOduration=12.105584794 podStartE2EDuration="22.000355902s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.139156123 +0000 UTC m=+3.152707310" lastFinishedPulling="2026-05-20 14:06:51.033927233 +0000 UTC m=+13.047478418" observedRunningTime="2026-05-20 14:06:59.813667156 +0000 UTC m=+21.827218351" watchObservedRunningTime="2026-05-20 14:07:00.000355902 +0000 UTC m=+22.013907100" May 20 14:07:00.434248 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.433915 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 14:07:00.515071 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.514890 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T14:07:00.433934319Z","UUID":"1e0db922-c0c7-40c2-854f-a06cf14d463a","Handler":null,"Name":"","Endpoint":""} May 20 14:07:00.516869 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.516828 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 14:07:00.516869 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.516872 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 14:07:00.568340 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.568266 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:00.568496 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:00.568374 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:07:00.710864 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.710842 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:07:00.711289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.711181 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"1a6aa1b4223bb0eb9bb6e755b50fa356a172bf0b390c83eca4a88d995acd17b5"} May 20 14:07:00.711289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.711210 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"f8bd0674d59daa9f20f89134d5068ff789ab54fdd0661458b6e262cf6ccb684f"} May 20 14:07:00.711289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.711219 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"ac7a2b6db7c6cefc3bcac9906232e174392385b78b3c2d6ae2d4364891425707"} May 20 14:07:00.712368 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.712347 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-slpxn" event={"ID":"57cb13d6-02b3-401e-a361-ff3337498297","Type":"ContainerStarted","Data":"c8377fcd827513efe7c176da943ba1e5f241cf9fe2309d36a15a2a188a439b34"} May 20 14:07:00.713822 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:00.713798 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" event={"ID":"2c84e303-6cfb-4abc-9982-c5266d725932","Type":"ContainerStarted","Data":"b97d643d883b6381ca7274f04f3299f4cc30a2378d7f38b7ae834eb5cc4fd161"} May 20 14:07:01.434127 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:01.434041 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:01.434387 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:01.434222 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:07:01.434387 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:01.434297 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret podName:df54abc0-d4ac-4103-94f7-94df3d3dc8f4 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:17.434277396 +0000 UTC m=+39.447828570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret") pod "global-pull-secret-syncer-fl7sz" (UID: "df54abc0-d4ac-4103-94f7-94df3d3dc8f4") : object "kube-system"/"original-pull-secret" not registered May 20 14:07:01.567933 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:01.567897 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:01.568092 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:01.567896 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:01.568092 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:01.568041 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:07:01.568164 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:01.568116 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:01.717464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:01.717326 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" event={"ID":"2c84e303-6cfb-4abc-9982-c5266d725932","Type":"ContainerStarted","Data":"1e40deac0a4625dd6fbeb4cbd5696f77f069c4acf283db6a8c40789c12a6da71"} May 20 14:07:01.717464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:01.717386 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 20 14:07:01.736262 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:01.736209 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-slpxn" podStartSLOduration=5.701695816 podStartE2EDuration="23.736195213s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.165971783 +0000 UTC m=+3.179522961" lastFinishedPulling="2026-05-20 14:06:59.200471179 +0000 UTC m=+21.214022358" observedRunningTime="2026-05-20 14:07:01.735761525 +0000 UTC m=+23.749312720" watchObservedRunningTime="2026-05-20 14:07:01.736195213 +0000 UTC m=+23.749746408" May 20 14:07:02.567455 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:02.567373 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:02.567615 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:02.567487 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:07:02.722411 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:02.722382 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:07:02.722874 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:02.722759 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"c100770e9b329c5e5785e73cfa5a98649d1fc778be516fba169dc1bf9ae5c96e"} May 20 14:07:02.742240 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:02.742187 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phq9k" podStartSLOduration=4.287974045 podStartE2EDuration="24.742166704s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.162920239 +0000 UTC m=+3.176471425" lastFinishedPulling="2026-05-20 14:07:01.617112897 +0000 UTC m=+23.630664084" observedRunningTime="2026-05-20 14:07:02.7416072 +0000 UTC m=+24.755158396" watchObservedRunningTime="2026-05-20 14:07:02.742166704 +0000 UTC m=+24.755717903" May 20 14:07:03.568009 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:03.567817 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:03.568203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:03.567822 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:03.568203 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:03.568100 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:07:03.568203 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:03.568180 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:04.568321 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.568295 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:04.568871 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:04.568428 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:07:04.727994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.727959 2555 generic.go:358] "Generic (PLEG): container finished" podID="3a2bf97b-1e34-48d4-b216-e624c83db7d9" containerID="15544492c2e76a7d78fd75fde841247100254f51133654f049f6fdacfe966f7f" exitCode=0 May 20 14:07:04.728149 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.728051 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerDied","Data":"15544492c2e76a7d78fd75fde841247100254f51133654f049f6fdacfe966f7f"} May 20 14:07:04.730946 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.730927 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:07:04.731271 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.731252 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"fc2142c135da8bd574ad2fba2395d27957af1d4eab449a34ff3795ee71f160e2"} May 20 14:07:04.732353 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.732133 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:07:04.732353 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.732172 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:07:04.732353 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.732196 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:07:04.732690 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.732419 2555 scope.go:117] "RemoveContainer" containerID="e514338e67dec30cd602bb18f9f711e9de33e7bd2d1427e98aad9c2a248823e7" May 20 14:07:04.751081 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.751056 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:07:04.751162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:04.751151 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:07:05.567828 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:05.567784 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:05.568011 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:05.567784 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:05.568011 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:05.567893 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:07:05.568011 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:05.567997 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:05.738209 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:05.738177 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:07:05.738649 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:05.738622 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" event={"ID":"727cfc25-9233-4c78-aff7-ab457355d6bd","Type":"ContainerStarted","Data":"5ab193428b903d86b21de17f6c6529b23e62e8a7c027e6e93ab466de86c750d4"} May 20 14:07:06.439893 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.439779 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" podStartSLOduration=9.346477756 podStartE2EDuration="27.439762053s" podCreationTimestamp="2026-05-20 14:06:39 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.136766304 +0000 UTC m=+3.150317483" lastFinishedPulling="2026-05-20 14:06:59.230050601 +0000 UTC m=+21.243601780" observedRunningTime="2026-05-20 14:07:05.771859169 +0000 UTC m=+27.785410364" watchObservedRunningTime="2026-05-20 14:07:06.439762053 +0000 UTC m=+28.453313246" May 20 14:07:06.440599 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.440566 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fl7sz"] May 20 14:07:06.440699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.440690 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:06.440793 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:06.440775 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:07:06.443589 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.443554 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7f65r"] May 20 14:07:06.443728 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.443700 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:06.443830 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:06.443807 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:07:06.444247 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.444217 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxsxj"] May 20 14:07:06.444339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.444328 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:06.444436 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:06.444411 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:06.741886 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.741857 2555 generic.go:358] "Generic (PLEG): container finished" podID="3a2bf97b-1e34-48d4-b216-e624c83db7d9" containerID="9a3f77fbd23b74d0aaf700590e9e11a693fa8432561513e4bccaf2c049183e45" exitCode=0 May 20 14:07:06.742225 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:06.741945 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerDied","Data":"9a3f77fbd23b74d0aaf700590e9e11a693fa8432561513e4bccaf2c049183e45"} May 20 14:07:07.567596 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:07.567548 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:07.567756 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:07.567671 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:08.568168 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.568126 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:08.568606 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:08.568253 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:07:08.568606 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.568316 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:08.568606 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:08.568445 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:07:08.747537 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.747448 2555 generic.go:358] "Generic (PLEG): container finished" podID="3a2bf97b-1e34-48d4-b216-e624c83db7d9" containerID="5ddab8967ed0b4d42da096e66c3b11b05340fad350729f7c0891f74e2cc688bb" exitCode=0 May 20 14:07:08.747537 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.747486 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerDied","Data":"5ddab8967ed0b4d42da096e66c3b11b05340fad350729f7c0891f74e2cc688bb"} May 20 14:07:08.758578 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.758556 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4pkds" May 20 14:07:08.758672 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.758662 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 20 14:07:08.759040 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:08.759023 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4pkds" May 20 14:07:09.567563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:09.567313 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:09.567741 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:09.567693 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:10.567881 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:10.567849 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:10.568291 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:10.567849 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:10.568291 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:10.567955 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fl7sz" podUID="df54abc0-d4ac-4103-94f7-94df3d3dc8f4" May 20 14:07:10.568291 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:10.568022 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f65r" podUID="0bffb07c-ae62-4a5b-aee8-141ab60cc050" May 20 14:07:11.568120 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:11.568089 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:11.568627 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:11.568199 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxsxj" podUID="2cd0dd56-cecd-4f98-a24d-5f18754736d3" May 20 14:07:12.217124 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.217090 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:12.217289 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.217253 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:12.217338 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.217330 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:44.217306583 +0000 UTC m=+66.230857779 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:12.274247 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.274220 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-178.ec2.internal" event="NodeReady" May 20 14:07:12.274414 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.274365 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 14:07:12.311741 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.311713 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dd57949f7-lklbt"] May 20 14:07:12.322638 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.322612 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.325591 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.325554 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 14:07:12.325725 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.325682 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 14:07:12.325924 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.325904 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 14:07:12.326134 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.326114 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-js5jf\"" May 20 14:07:12.327788 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.327765 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-phjjw"] May 20 14:07:12.332456 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.332062 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 14:07:12.336108 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.336088 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd57949f7-lklbt"] May 20 14:07:12.336233 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.336117 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9zcc5"] May 20 14:07:12.336422 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.336402 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.338843 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.338814 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 14:07:12.339516 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.339360 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9jh8\"" May 20 14:07:12.339671 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.339653 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 14:07:12.346858 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.346826 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:12.349411 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.349372 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 14:07:12.349571 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.349380 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g69fg\"" May 20 14:07:12.349660 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.349625 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 14:07:12.349720 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.349657 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 14:07:12.352300 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.352278 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phjjw"] May 20 14:07:12.352608 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.352593 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9zcc5"] May 20 14:07:12.419285 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419249 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-trusted-ca\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.419285 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f20d64-745b-43eb-ae14-2c56aa915574-tmp-dir\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.419552 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.419552 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34c2128-c8c0-4f11-95ee-f7ddb996a461-ca-trust-extracted\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.419552 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419461 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:12.419552 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.419552 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-certificates\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.419575 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419588 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-bound-sa-token\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3f20d64-745b-43eb-ae14-2c56aa915574-config-volume\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.419594 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.419694 2555 projected.go:194] Error preparing data for projected volume kube-api-access-728gh for pod openshift-network-diagnostics/network-check-target-7f65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419667 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-image-registry-private-configuration\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.419784 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.419762 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh podName:0bffb07c-ae62-4a5b-aee8-141ab60cc050 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:44.419741592 +0000 UTC m=+66.433292784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-728gh" (UniqueName: "kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh") pod "network-check-target-7f65r" (UID: "0bffb07c-ae62-4a5b-aee8-141ab60cc050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:12.420058 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419799 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/b3f20d64-745b-43eb-ae14-2c56aa915574-kube-api-access-6lqps\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.420058 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-installation-pull-secrets\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.420058 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.419863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgq4\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-kube-api-access-sxgq4\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.520939 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.520857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-bound-sa-token\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.520939 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.520904 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3f20d64-745b-43eb-ae14-2c56aa915574-config-volume\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.521158 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.520944 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-image-registry-private-configuration\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521158 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.520968 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/b3f20d64-745b-43eb-ae14-2c56aa915574-kube-api-access-6lqps\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.521158 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.520994 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-installation-pull-secrets\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521158 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521019 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgq4\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-kube-api-access-sxgq4\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521158 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521132 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-trusted-ca\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521174 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f20d64-745b-43eb-ae14-2c56aa915574-tmp-dir\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.521426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tns4q\" (UniqueName: \"kubernetes.io/projected/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-kube-api-access-tns4q\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:12.521426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:12.521426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521281 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521357 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34c2128-c8c0-4f11-95ee-f7ddb996a461-ca-trust-extracted\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521475 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.521701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521532 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-certificates\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f20d64-745b-43eb-ae14-2c56aa915574-tmp-dir\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.521701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3f20d64-745b-43eb-ae14-2c56aa915574-config-volume\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.521902 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.521717 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:12.521902 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.521739 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:12.521902 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.521790 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:13.021772415 +0000 UTC m=+35.035323606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:12.521902 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.521848 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34c2128-c8c0-4f11-95ee-f7ddb996a461-ca-trust-extracted\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.521902 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.521899 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:12.522162 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.521962 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:13.021945549 +0000 UTC m=+35.035496723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:12.522221 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.522161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-trusted-ca\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.522346 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.522328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-certificates\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.525752 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.525730 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-installation-pull-secrets\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.525873 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.525790 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-image-registry-private-configuration\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.532676 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.532648 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-bound-sa-token\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.532676 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.532679 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/b3f20d64-745b-43eb-ae14-2c56aa915574-kube-api-access-6lqps\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:12.532950 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.532925 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgq4\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-kube-api-access-sxgq4\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:12.567559 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.567530 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:12.567755 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.567734 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:12.570419 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.570394 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 14:07:12.571077 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.570451 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 14:07:12.571077 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.570458 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 14:07:12.571077 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.570459 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88x2p\"" May 20 14:07:12.622946 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.622872 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tns4q\" (UniqueName: \"kubernetes.io/projected/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-kube-api-access-tns4q\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:12.622946 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.622922 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:12.623230 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.623053 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:12.623230 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:12.623120 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:07:13.123102386 +0000 UTC m=+35.136653561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:12.636148 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:12.636123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tns4q\" (UniqueName: \"kubernetes.io/projected/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-kube-api-access-tns4q\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:13.025953 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:13.025917 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:13.026182 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:13.026041 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:13.026182 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.026086 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:13.026182 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.026136 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:13.026182 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.026147 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:13.026182 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.026159 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:14.026138226 +0000 UTC m=+36.039689413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:13.026182 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.026182 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:14.026170909 +0000 UTC m=+36.039722082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:13.126753 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:13.126669 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:13.126948 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.126835 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:13.126948 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:13.126905 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:07:14.126890349 +0000 UTC m=+36.140441522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:13.567530 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:13.567487 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:13.570165 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:13.570140 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 14:07:13.570295 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:13.570148 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rhhv\"" May 20 14:07:14.035581 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:14.035531 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:14.036123 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:14.035611 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:14.036123 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.035692 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:14.036123 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.035714 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:14.036123 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.035753 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:14.036123 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.035774 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:16.035755339 +0000 UTC m=+38.049306513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:14.036123 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.035807 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:16.035790005 +0000 UTC m=+38.049341179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:14.136052 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:14.136014 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:14.136252 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.136174 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:14.136252 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:14.136250 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:07:16.136228225 +0000 UTC m=+38.149779400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:15.765473 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:15.765288 2555 generic.go:358] "Generic (PLEG): container finished" podID="3a2bf97b-1e34-48d4-b216-e624c83db7d9" containerID="5bc656c3ad1b2e6d181ea1074bad679f9c27ec963b5f67a8ae2b3d108db31c44" exitCode=0 May 20 14:07:15.765856 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:15.765373 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerDied","Data":"5bc656c3ad1b2e6d181ea1074bad679f9c27ec963b5f67a8ae2b3d108db31c44"} May 20 14:07:16.053524 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:16.053426 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:16.053524 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:16.053476 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:16.053673 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.053588 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:16.053673 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.053608 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:16.053673 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.053653 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:20.053641017 +0000 UTC m=+42.067192190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:16.053673 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.053610 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:16.053794 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.053684 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:20.053677789 +0000 UTC m=+42.067228962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:16.154134 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:16.154107 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:16.154263 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.154242 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:16.154319 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:16.154309 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:07:20.154293697 +0000 UTC m=+42.167844870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:16.769739 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:16.769709 2555 generic.go:358] "Generic (PLEG): container finished" podID="3a2bf97b-1e34-48d4-b216-e624c83db7d9" containerID="133a903c5b512be64ed1b90431556bbb821a5afb9e2a6dc682ca6d47d0b44e83" exitCode=0 May 20 14:07:16.770115 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:16.769755 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerDied","Data":"133a903c5b512be64ed1b90431556bbb821a5afb9e2a6dc682ca6d47d0b44e83"} May 20 14:07:17.464369 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:17.464326 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:17.467677 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:17.467643 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df54abc0-d4ac-4103-94f7-94df3d3dc8f4-original-pull-secret\") pod \"global-pull-secret-syncer-fl7sz\" (UID: \"df54abc0-d4ac-4103-94f7-94df3d3dc8f4\") " pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:17.682661 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:17.682617 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fl7sz" May 20 14:07:17.775989 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:17.775951 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq89j" event={"ID":"3a2bf97b-1e34-48d4-b216-e624c83db7d9","Type":"ContainerStarted","Data":"2172b046f6a8c02ec3c70c63f3e65bc4ba1c3ddbeac22beb7ed2e4cac559a7e6"} May 20 14:07:17.811401 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:17.811349 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tq89j" podStartSLOduration=5.875152018 podStartE2EDuration="39.811334616s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:06:41.139168296 +0000 UTC m=+3.152719486" lastFinishedPulling="2026-05-20 14:07:15.075350897 +0000 UTC m=+37.088902084" observedRunningTime="2026-05-20 14:07:17.80961787 +0000 UTC m=+39.823169065" watchObservedRunningTime="2026-05-20 14:07:17.811334616 +0000 UTC m=+39.824885810" May 20 14:07:17.820813 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:17.820789 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fl7sz"] May 20 14:07:17.824108 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:07:17.824083 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf54abc0_d4ac_4103_94f7_94df3d3dc8f4.slice/crio-192c83ad240ceea409fbb5c441522f7041028c9a331e96a2b0bf3a702796d78b WatchSource:0}: Error finding container 192c83ad240ceea409fbb5c441522f7041028c9a331e96a2b0bf3a702796d78b: Status 404 returned error can't find the container with id 192c83ad240ceea409fbb5c441522f7041028c9a331e96a2b0bf3a702796d78b May 20 14:07:18.779259 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:18.779221 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fl7sz" event={"ID":"df54abc0-d4ac-4103-94f7-94df3d3dc8f4","Type":"ContainerStarted","Data":"192c83ad240ceea409fbb5c441522f7041028c9a331e96a2b0bf3a702796d78b"} May 20 14:07:20.085784 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:20.085750 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:20.085784 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:20.085795 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:20.086275 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.085909 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:20.086275 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.085921 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:20.086275 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.085946 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:20.086275 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.085977 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:28.085958711 +0000 UTC m=+50.099509884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:20.086275 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.086003 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:28.085985537 +0000 UTC m=+50.099536731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:20.187129 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:20.187088 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:20.187304 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.187247 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:20.187370 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:20.187328 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:07:28.187307237 +0000 UTC m=+50.200858421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:21.786895 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:21.786791 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fl7sz" event={"ID":"df54abc0-d4ac-4103-94f7-94df3d3dc8f4","Type":"ContainerStarted","Data":"6c03e102b80d933d14e2a8bcfe83013391e8f2052d153bad3048ae327f524790"} May 20 14:07:21.806985 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:21.806930 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fl7sz" podStartSLOduration=33.116883426 podStartE2EDuration="36.806915075s" podCreationTimestamp="2026-05-20 14:06:45 +0000 UTC" firstStartedPulling="2026-05-20 14:07:17.825873096 +0000 UTC m=+39.839424282" lastFinishedPulling="2026-05-20 14:07:21.515904741 +0000 UTC m=+43.529455931" observedRunningTime="2026-05-20 14:07:21.806135884 +0000 UTC m=+43.819687079" watchObservedRunningTime="2026-05-20 14:07:21.806915075 +0000 UTC m=+43.820466270" May 20 14:07:28.144082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:28.144037 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:28.144445 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:28.144091 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:28.144445 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.144178 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:28.144445 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.144195 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:28.144445 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.144199 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:28.144445 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.144253 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:44.144235331 +0000 UTC m=+66.157786506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:28.144445 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.144271 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:44.144262819 +0000 UTC m=+66.157813993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:28.244991 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:28.244962 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:28.245122 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.245105 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:28.245172 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:28.245161 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:07:44.245146498 +0000 UTC m=+66.258697671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:36.752713 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:36.752687 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nrmg" May 20 14:07:44.162138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.162090 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:07:44.162138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.162143 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:07:44.162572 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.162231 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:44.162572 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.162237 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:07:44.162572 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.162254 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:07:44.162572 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.162280 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:16.162267432 +0000 UTC m=+98.175818605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:07:44.162572 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.162298 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:16.162285484 +0000 UTC m=+98.175836658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:07:44.262604 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.262566 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:07:44.262604 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.262611 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:07:44.262789 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.262711 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:44.262789 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.262775 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:08:16.262760513 +0000 UTC m=+98.276311686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:07:44.265382 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.265367 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 14:07:44.273326 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.273312 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 14:07:44.273393 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:07:44.273355 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs podName:2cd0dd56-cecd-4f98-a24d-5f18754736d3 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:48.273344435 +0000 UTC m=+130.286895612 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs") pod "network-metrics-daemon-rxsxj" (UID: "2cd0dd56-cecd-4f98-a24d-5f18754736d3") : secret "metrics-daemon-secret" not found May 20 14:07:44.464568 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.464535 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:44.467776 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.467759 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 14:07:44.477472 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.477456 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 14:07:44.487861 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.487836 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-728gh\" (UniqueName: \"kubernetes.io/projected/0bffb07c-ae62-4a5b-aee8-141ab60cc050-kube-api-access-728gh\") pod \"network-check-target-7f65r\" (UID: \"0bffb07c-ae62-4a5b-aee8-141ab60cc050\") " pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:44.680068 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.680037 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88x2p\"" May 20 14:07:44.688122 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.688105 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:44.836365 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:44.836330 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7f65r"] May 20 14:07:44.839422 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:07:44.839399 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bffb07c_ae62_4a5b_aee8_141ab60cc050.slice/crio-08f11ada869f39fad918f1dcce4ed06766c2df851cf8aa587287c3e8d02903eb WatchSource:0}: Error finding container 08f11ada869f39fad918f1dcce4ed06766c2df851cf8aa587287c3e8d02903eb: Status 404 returned error can't find the container with id 08f11ada869f39fad918f1dcce4ed06766c2df851cf8aa587287c3e8d02903eb May 20 14:07:45.835118 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:45.835081 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7f65r" event={"ID":"0bffb07c-ae62-4a5b-aee8-141ab60cc050","Type":"ContainerStarted","Data":"08f11ada869f39fad918f1dcce4ed06766c2df851cf8aa587287c3e8d02903eb"} May 20 14:07:47.840496 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:47.840456 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7f65r" event={"ID":"0bffb07c-ae62-4a5b-aee8-141ab60cc050","Type":"ContainerStarted","Data":"18afaa2c2bdbabdd8a3e82a476146cca19995aabe030186d6b7495ec1a1d07bc"} May 20 14:07:47.840905 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:47.840538 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:07:47.859812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:07:47.859768 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7f65r" podStartSLOduration=67.03739954 podStartE2EDuration="1m9.859753603s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:07:44.841063818 +0000 UTC m=+66.854614991" lastFinishedPulling="2026-05-20 14:07:47.663417865 +0000 UTC m=+69.676969054" observedRunningTime="2026-05-20 14:07:47.858718402 +0000 UTC m=+69.872269600" watchObservedRunningTime="2026-05-20 14:07:47.859753603 +0000 UTC m=+69.873304797" May 20 14:08:05.592834 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.592689 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq"] May 20 14:08:05.595064 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.595042 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh"] May 20 14:08:05.595217 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.595194 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.596405 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.596386 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.599012 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.598997 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 20 14:08:05.599287 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.599273 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 20 14:08:05.599601 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.599588 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sx84q\"" May 20 14:08:05.601789 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.601753 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 14:08:05.601866 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.601815 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4bgsx\"" May 20 14:08:05.601932 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.601872 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 20 14:08:05.601998 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.601954 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 20 14:08:05.602058 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.601755 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 20 14:08:05.602122 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.602059 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 14:08:05.602122 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.602060 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 20 14:08:05.614443 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.614422 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh"] May 20 14:08:05.615104 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.615086 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq"] May 20 14:08:05.710790 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.710752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.710974 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.710832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9qzm\" (UniqueName: \"kubernetes.io/projected/d2382e51-a33d-4642-a843-69fd2b3a7402-kube-api-access-q9qzm\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.710974 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.710872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6d76e9f-545d-441f-8084-2e96630e03c7-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.710974 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.710888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2382e51-a33d-4642-a843-69fd2b3a7402-serving-cert\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.710974 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.710917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fp62\" (UniqueName: \"kubernetes.io/projected/e6d76e9f-545d-441f-8084-2e96630e03c7-kube-api-access-8fp62\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.710974 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.710935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2382e51-a33d-4642-a843-69fd2b3a7402-config\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.811705 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.811661 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.811892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.811765 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9qzm\" (UniqueName: \"kubernetes.io/projected/d2382e51-a33d-4642-a843-69fd2b3a7402-kube-api-access-q9qzm\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.811892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.811804 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6d76e9f-545d-441f-8084-2e96630e03c7-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.811892 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:05.811820 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 14:08:05.812057 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:05.811905 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls podName:e6d76e9f-545d-441f-8084-2e96630e03c7 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:06.311888697 +0000 UTC m=+88.325439869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-spnkh" (UID: "e6d76e9f-545d-441f-8084-2e96630e03c7") : secret "cluster-monitoring-operator-tls" not found May 20 14:08:05.812057 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.811829 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2382e51-a33d-4642-a843-69fd2b3a7402-serving-cert\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.812057 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.812001 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fp62\" (UniqueName: \"kubernetes.io/projected/e6d76e9f-545d-441f-8084-2e96630e03c7-kube-api-access-8fp62\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.812057 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.812033 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2382e51-a33d-4642-a843-69fd2b3a7402-config\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.812458 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.812439 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2382e51-a33d-4642-a843-69fd2b3a7402-config\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.812576 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.812557 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6d76e9f-545d-441f-8084-2e96630e03c7-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.814094 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.814075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2382e51-a33d-4642-a843-69fd2b3a7402-serving-cert\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.822767 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.822740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9qzm\" (UniqueName: \"kubernetes.io/projected/d2382e51-a33d-4642-a843-69fd2b3a7402-kube-api-access-q9qzm\") pod \"service-ca-operator-57b5b68b8-mslcq\" (UID: \"d2382e51-a33d-4642-a843-69fd2b3a7402\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:05.829074 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.829048 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fp62\" (UniqueName: \"kubernetes.io/projected/e6d76e9f-545d-441f-8084-2e96630e03c7-kube-api-access-8fp62\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:05.905356 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:05.905284 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" May 20 14:08:06.034998 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:06.034964 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq"] May 20 14:08:06.038764 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:06.038737 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2382e51_a33d_4642_a843_69fd2b3a7402.slice/crio-ca89c6dd134229adf6e655615c8d78796aff4c5ec87979a72797a554964a00d6 WatchSource:0}: Error finding container ca89c6dd134229adf6e655615c8d78796aff4c5ec87979a72797a554964a00d6: Status 404 returned error can't find the container with id ca89c6dd134229adf6e655615c8d78796aff4c5ec87979a72797a554964a00d6 May 20 14:08:06.315723 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:06.315675 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:06.315918 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:06.315821 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 14:08:06.315918 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:06.315891 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls podName:e6d76e9f-545d-441f-8084-2e96630e03c7 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:07.315875644 +0000 UTC m=+89.329426817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-spnkh" (UID: "e6d76e9f-545d-441f-8084-2e96630e03c7") : secret "cluster-monitoring-operator-tls" not found May 20 14:08:06.876094 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:06.876041 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" event={"ID":"d2382e51-a33d-4642-a843-69fd2b3a7402","Type":"ContainerStarted","Data":"ca89c6dd134229adf6e655615c8d78796aff4c5ec87979a72797a554964a00d6"} May 20 14:08:07.324315 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:07.324277 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:07.324530 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:07.324415 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 14:08:07.324530 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:07.324526 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls podName:e6d76e9f-545d-441f-8084-2e96630e03c7 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:09.324485324 +0000 UTC m=+91.338036496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-spnkh" (UID: "e6d76e9f-545d-441f-8084-2e96630e03c7") : secret "cluster-monitoring-operator-tls" not found May 20 14:08:08.881601 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:08.881564 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" event={"ID":"d2382e51-a33d-4642-a843-69fd2b3a7402","Type":"ContainerStarted","Data":"e4275cd884ee51b20dac1421dda2fd9bcc3d2155005d791b514e2d49d93a2cb7"} May 20 14:08:09.341458 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:09.341415 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:09.341682 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:09.341543 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 14:08:09.341682 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:09.341596 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls podName:e6d76e9f-545d-441f-8084-2e96630e03c7 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:13.341582544 +0000 UTC m=+95.355133718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-spnkh" (UID: "e6d76e9f-545d-441f-8084-2e96630e03c7") : secret "cluster-monitoring-operator-tls" not found May 20 14:08:11.042252 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.042202 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" podStartSLOduration=3.871038913 podStartE2EDuration="6.042188263s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="2026-05-20 14:08:06.040541141 +0000 UTC m=+88.054092329" lastFinishedPulling="2026-05-20 14:08:08.211690488 +0000 UTC m=+90.225241679" observedRunningTime="2026-05-20 14:08:08.905997368 +0000 UTC m=+90.919548566" watchObservedRunningTime="2026-05-20 14:08:11.042188263 +0000 UTC m=+93.055739457" May 20 14:08:11.042650 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.042596 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955"] May 20 14:08:11.044321 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.044297 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" May 20 14:08:11.054295 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.054278 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 20 14:08:11.054938 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.054917 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 20 14:08:11.056539 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.056522 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d6nlh\"" May 20 14:08:11.082543 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.082517 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955"] May 20 14:08:11.154899 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.154863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9cfp\" (UniqueName: \"kubernetes.io/projected/d5a08567-7561-4db7-8ff6-5b2a4b219347-kube-api-access-l9cfp\") pod \"migrator-b985f5d89-kw955\" (UID: \"d5a08567-7561-4db7-8ff6-5b2a4b219347\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" May 20 14:08:11.255884 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.255847 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9cfp\" (UniqueName: \"kubernetes.io/projected/d5a08567-7561-4db7-8ff6-5b2a4b219347-kube-api-access-l9cfp\") pod \"migrator-b985f5d89-kw955\" (UID: \"d5a08567-7561-4db7-8ff6-5b2a4b219347\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" May 20 14:08:11.268171 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.268146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9cfp\" (UniqueName: \"kubernetes.io/projected/d5a08567-7561-4db7-8ff6-5b2a4b219347-kube-api-access-l9cfp\") pod \"migrator-b985f5d89-kw955\" (UID: \"d5a08567-7561-4db7-8ff6-5b2a4b219347\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" May 20 14:08:11.352375 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.352305 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" May 20 14:08:11.487454 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.487418 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955"] May 20 14:08:11.490885 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:11.490849 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a08567_7561_4db7_8ff6_5b2a4b219347.slice/crio-780642b2995602fbd839d9b258c5505baac61159444d2f2b42e8fc6c4ab60a3b WatchSource:0}: Error finding container 780642b2995602fbd839d9b258c5505baac61159444d2f2b42e8fc6c4ab60a3b: Status 404 returned error can't find the container with id 780642b2995602fbd839d9b258c5505baac61159444d2f2b42e8fc6c4ab60a3b May 20 14:08:11.547590 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.547564 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsvdz_5fd33346-cf67-4b07-9057-dc6075a620c7/dns-node-resolver/0.log" May 20 14:08:11.887648 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.887605 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" event={"ID":"d5a08567-7561-4db7-8ff6-5b2a4b219347","Type":"ContainerStarted","Data":"780642b2995602fbd839d9b258c5505baac61159444d2f2b42e8fc6c4ab60a3b"} May 20 14:08:11.899959 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.899932 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lqbq8"] May 20 14:08:11.902163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.902145 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:11.905182 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.905161 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 20 14:08:11.906289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.906243 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 20 14:08:11.906289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.906260 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8jr4w\"" May 20 14:08:11.906453 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.906243 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 20 14:08:11.906616 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.906579 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 20 14:08:11.913394 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.913375 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lqbq8"] May 20 14:08:11.961035 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.960990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m594\" (UniqueName: \"kubernetes.io/projected/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-kube-api-access-6m594\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:11.961213 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.961146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-signing-cabundle\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:11.961213 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:11.961191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-signing-key\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.061679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.061642 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6m594\" (UniqueName: \"kubernetes.io/projected/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-kube-api-access-6m594\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.062046 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.061794 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-signing-cabundle\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.062046 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.061815 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-signing-key\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.062456 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.062438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-signing-cabundle\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.064097 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.064080 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-signing-key\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.071009 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.070989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m594\" (UniqueName: \"kubernetes.io/projected/92cbf9bc-ad55-491b-84c6-9a848cc1b1c6-kube-api-access-6m594\") pod \"service-ca-67d667c7d-lqbq8\" (UID: \"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6\") " pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.213017 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.212926 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" May 20 14:08:12.345526 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.345479 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lqbq8"] May 20 14:08:12.517006 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:12.516961 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cbf9bc_ad55_491b_84c6_9a848cc1b1c6.slice/crio-85eb6c156438e90df09d1ba97829b973e25363381ed48b81b0df48b19da2f390 WatchSource:0}: Error finding container 85eb6c156438e90df09d1ba97829b973e25363381ed48b81b0df48b19da2f390: Status 404 returned error can't find the container with id 85eb6c156438e90df09d1ba97829b973e25363381ed48b81b0df48b19da2f390 May 20 14:08:12.546425 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.546407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pnxgt_8674ca5b-4b88-422c-9b77-50fb73dfef07/node-ca/0.log" May 20 14:08:12.892180 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.892090 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" event={"ID":"d5a08567-7561-4db7-8ff6-5b2a4b219347","Type":"ContainerStarted","Data":"cda70bca3952f3a115310924f6588306820963a855ae1f4a86e3f796be6734f6"} May 20 14:08:12.892180 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.892130 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" event={"ID":"d5a08567-7561-4db7-8ff6-5b2a4b219347","Type":"ContainerStarted","Data":"eb7701f1506eefa7a6a858614d545ef5708ca3d170d651f4bcab93c23284629d"} May 20 14:08:12.893362 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.893339 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" event={"ID":"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6","Type":"ContainerStarted","Data":"6e2b45fb3031040a15fbf933396cca3044d68a080c1d7f31ac0e402f747cbf18"} May 20 14:08:12.893455 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.893365 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" event={"ID":"92cbf9bc-ad55-491b-84c6-9a848cc1b1c6","Type":"ContainerStarted","Data":"85eb6c156438e90df09d1ba97829b973e25363381ed48b81b0df48b19da2f390"} May 20 14:08:12.917073 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.917033 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-kw955" podStartSLOduration=1.868206714 podStartE2EDuration="2.917021844s" podCreationTimestamp="2026-05-20 14:08:10 +0000 UTC" firstStartedPulling="2026-05-20 14:08:11.492572124 +0000 UTC m=+93.506123301" lastFinishedPulling="2026-05-20 14:08:12.54138724 +0000 UTC m=+94.554938431" observedRunningTime="2026-05-20 14:08:12.916199616 +0000 UTC m=+94.929750810" watchObservedRunningTime="2026-05-20 14:08:12.917021844 +0000 UTC m=+94.930573039" May 20 14:08:12.934077 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:12.934028 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-lqbq8" podStartSLOduration=1.934013941 podStartE2EDuration="1.934013941s" podCreationTimestamp="2026-05-20 14:08:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:08:12.933461995 +0000 UTC m=+94.947013190" watchObservedRunningTime="2026-05-20 14:08:12.934013941 +0000 UTC m=+94.947565137" May 20 14:08:13.369826 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:13.369769 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:13.370212 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:13.369898 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 14:08:13.370212 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:13.369956 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls podName:e6d76e9f-545d-441f-8084-2e96630e03c7 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:21.369941336 +0000 UTC m=+103.383492509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-spnkh" (UID: "e6d76e9f-545d-441f-8084-2e96630e03c7") : secret "cluster-monitoring-operator-tls" not found May 20 14:08:16.194878 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:16.194829 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") pod \"image-registry-6dd57949f7-lklbt\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:08:16.195317 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:16.194889 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:08:16.195317 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.194991 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 14:08:16.195317 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.195017 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd57949f7-lklbt: secret "image-registry-tls" not found May 20 14:08:16.195317 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.195027 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:08:16.195317 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.195085 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls podName:b3f20d64-745b-43eb-ae14-2c56aa915574 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:20.195069679 +0000 UTC m=+162.208620852 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls") pod "dns-default-phjjw" (UID: "b3f20d64-745b-43eb-ae14-2c56aa915574") : secret "dns-default-metrics-tls" not found May 20 14:08:16.195317 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.195100 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls podName:f34c2128-c8c0-4f11-95ee-f7ddb996a461 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:20.195093776 +0000 UTC m=+162.208644948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls") pod "image-registry-6dd57949f7-lklbt" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461") : secret "image-registry-tls" not found May 20 14:08:16.295771 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:16.295740 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:08:16.295957 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.295883 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:08:16.295957 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:16.295940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert podName:bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:20.2959268 +0000 UTC m=+162.309477978 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert") pod "ingress-canary-9zcc5" (UID: "bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f") : secret "canary-serving-cert" not found May 20 14:08:18.845555 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:18.845521 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7f65r" May 20 14:08:21.435878 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:21.435843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:21.438232 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:21.438212 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6d76e9f-545d-441f-8084-2e96630e03c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-spnkh\" (UID: \"e6d76e9f-545d-441f-8084-2e96630e03c7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:21.509804 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:21.509780 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" May 20 14:08:21.639481 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:21.639445 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh"] May 20 14:08:21.643794 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:21.643768 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d76e9f_545d_441f_8084_2e96630e03c7.slice/crio-957773bf26f33f8f796293808bc9eb37d683ec98db876152fc560ca4db7c8e06 WatchSource:0}: Error finding container 957773bf26f33f8f796293808bc9eb37d683ec98db876152fc560ca4db7c8e06: Status 404 returned error can't find the container with id 957773bf26f33f8f796293808bc9eb37d683ec98db876152fc560ca4db7c8e06 May 20 14:08:21.918941 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:21.918908 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" event={"ID":"e6d76e9f-545d-441f-8084-2e96630e03c7","Type":"ContainerStarted","Data":"957773bf26f33f8f796293808bc9eb37d683ec98db876152fc560ca4db7c8e06"} May 20 14:08:23.925701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:23.925624 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" event={"ID":"e6d76e9f-545d-441f-8084-2e96630e03c7","Type":"ContainerStarted","Data":"c3d0fd53b7e7d2cff30c5ba3e3b50b862a9bdba2c714bdf9768a201fdcc8f312"} May 20 14:08:23.953947 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:23.953903 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-spnkh" podStartSLOduration=16.935083471 podStartE2EDuration="18.953887792s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="2026-05-20 14:08:21.645471354 +0000 UTC m=+103.659022528" lastFinishedPulling="2026-05-20 14:08:23.664275673 +0000 UTC m=+105.677826849" observedRunningTime="2026-05-20 14:08:23.953039195 +0000 UTC m=+105.966590417" watchObservedRunningTime="2026-05-20 14:08:23.953887792 +0000 UTC m=+105.967439018" May 20 14:08:34.692733 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.692698 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj"] May 20 14:08:34.695581 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.695561 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:34.698169 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.698148 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 20 14:08:34.699146 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.699125 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 20 14:08:34.699424 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.699399 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 20 14:08:34.699658 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.699644 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-969cw\"" May 20 14:08:34.700285 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.700267 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 20 14:08:34.756813 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.756784 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj"] May 20 14:08:34.815015 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.814984 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j9rp9"] May 20 14:08:34.818921 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.818892 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:34.821814 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.821787 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 14:08:34.821814 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.821801 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 14:08:34.822021 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.821817 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 14:08:34.822021 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.821837 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gv257\"" May 20 14:08:34.822021 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.821790 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 14:08:34.830557 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.830521 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9rp9"] May 20 14:08:34.841890 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.841861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzwp8\" (UniqueName: \"kubernetes.io/projected/d15a724b-4ee2-4471-8ffe-63297e992b43-kube-api-access-bzwp8\") pod \"managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj\" (UID: \"d15a724b-4ee2-4471-8ffe-63297e992b43\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:34.842039 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.841943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d15a724b-4ee2-4471-8ffe-63297e992b43-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj\" (UID: \"d15a724b-4ee2-4471-8ffe-63297e992b43\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:34.943303 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0005332-f594-49fe-a8d0-2ab0150de227-crio-socket\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:34.943303 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943266 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d15a724b-4ee2-4471-8ffe-63297e992b43-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj\" (UID: \"d15a724b-4ee2-4471-8ffe-63297e992b43\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:34.943563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0005332-f594-49fe-a8d0-2ab0150de227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:34.943563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943403 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzwp8\" (UniqueName: \"kubernetes.io/projected/d15a724b-4ee2-4471-8ffe-63297e992b43-kube-api-access-bzwp8\") pod \"managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj\" (UID: \"d15a724b-4ee2-4471-8ffe-63297e992b43\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:34.943563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943483 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0005332-f594-49fe-a8d0-2ab0150de227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:34.943563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kjgt\" (UniqueName: \"kubernetes.io/projected/e0005332-f594-49fe-a8d0-2ab0150de227-kube-api-access-2kjgt\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:34.943771 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.943605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0005332-f594-49fe-a8d0-2ab0150de227-data-volume\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:34.945998 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.945971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d15a724b-4ee2-4471-8ffe-63297e992b43-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj\" (UID: \"d15a724b-4ee2-4471-8ffe-63297e992b43\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:34.962883 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:34.962859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzwp8\" (UniqueName: \"kubernetes.io/projected/d15a724b-4ee2-4471-8ffe-63297e992b43-kube-api-access-bzwp8\") pod \"managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj\" (UID: \"d15a724b-4ee2-4471-8ffe-63297e992b43\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:35.012616 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.012576 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" May 20 14:08:35.044522 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.044470 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0005332-f594-49fe-a8d0-2ab0150de227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.044723 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.044704 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0005332-f594-49fe-a8d0-2ab0150de227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.044781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.044749 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kjgt\" (UniqueName: \"kubernetes.io/projected/e0005332-f594-49fe-a8d0-2ab0150de227-kube-api-access-2kjgt\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.044819 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.044785 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0005332-f594-49fe-a8d0-2ab0150de227-data-volume\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.044868 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.044817 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0005332-f594-49fe-a8d0-2ab0150de227-crio-socket\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.044966 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.044949 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0005332-f594-49fe-a8d0-2ab0150de227-crio-socket\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.045168 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.045144 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0005332-f594-49fe-a8d0-2ab0150de227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.045232 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.045174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0005332-f594-49fe-a8d0-2ab0150de227-data-volume\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.046967 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.046944 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0005332-f594-49fe-a8d0-2ab0150de227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.053688 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.053653 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kjgt\" (UniqueName: \"kubernetes.io/projected/e0005332-f594-49fe-a8d0-2ab0150de227-kube-api-access-2kjgt\") pod \"insights-runtime-extractor-j9rp9\" (UID: \"e0005332-f594-49fe-a8d0-2ab0150de227\") " pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.129819 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.129783 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9rp9" May 20 14:08:35.140394 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.140368 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj"] May 20 14:08:35.144138 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:35.144113 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd15a724b_4ee2_4471_8ffe_63297e992b43.slice/crio-2c94af028b5e72a7b5cd8b79de2f054ebbfa15e76f178dbbba8fc9b435591434 WatchSource:0}: Error finding container 2c94af028b5e72a7b5cd8b79de2f054ebbfa15e76f178dbbba8fc9b435591434: Status 404 returned error can't find the container with id 2c94af028b5e72a7b5cd8b79de2f054ebbfa15e76f178dbbba8fc9b435591434 May 20 14:08:35.250966 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.250937 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9rp9"] May 20 14:08:35.254915 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:35.254887 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0005332_f594_49fe_a8d0_2ab0150de227.slice/crio-420af4ba3c142ccb2651ddcab0a620077e7d2e157babb74d31f6a40f156aa24e WatchSource:0}: Error finding container 420af4ba3c142ccb2651ddcab0a620077e7d2e157babb74d31f6a40f156aa24e: Status 404 returned error can't find the container with id 420af4ba3c142ccb2651ddcab0a620077e7d2e157babb74d31f6a40f156aa24e May 20 14:08:35.955170 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.955139 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" event={"ID":"d15a724b-4ee2-4471-8ffe-63297e992b43","Type":"ContainerStarted","Data":"2c94af028b5e72a7b5cd8b79de2f054ebbfa15e76f178dbbba8fc9b435591434"} May 20 14:08:35.956520 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.956480 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9rp9" event={"ID":"e0005332-f594-49fe-a8d0-2ab0150de227","Type":"ContainerStarted","Data":"5aece41499690ab7e27a0c06512521444993a9b4327c9cc6b426f51751af642e"} May 20 14:08:35.956610 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:35.956531 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9rp9" event={"ID":"e0005332-f594-49fe-a8d0-2ab0150de227","Type":"ContainerStarted","Data":"420af4ba3c142ccb2651ddcab0a620077e7d2e157babb74d31f6a40f156aa24e"} May 20 14:08:36.963915 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:36.963864 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9rp9" event={"ID":"e0005332-f594-49fe-a8d0-2ab0150de227","Type":"ContainerStarted","Data":"8920ef5ecd69a4f7ad5fd0300d46b017ab511cebbd95eca79a8876063d4c2137"} May 20 14:08:38.970679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:38.970642 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" event={"ID":"d15a724b-4ee2-4471-8ffe-63297e992b43","Type":"ContainerStarted","Data":"1512490be986b4fd2ac04b7f2dd794b8b56b719a57f2a8b7b8e8be7640d818a5"} May 20 14:08:38.972396 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:38.972372 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9rp9" event={"ID":"e0005332-f594-49fe-a8d0-2ab0150de227","Type":"ContainerStarted","Data":"4a59edf66b7e258c703a6d224ee9c94b70122779d4cf1c7b9f7402dc65578be8"} May 20 14:08:38.994090 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:38.994045 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b67bbbcd4-xq9tj" podStartSLOduration=1.814422096 podStartE2EDuration="4.994032337s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="2026-05-20 14:08:35.146277479 +0000 UTC m=+117.159828656" lastFinishedPulling="2026-05-20 14:08:38.325887724 +0000 UTC m=+120.339438897" observedRunningTime="2026-05-20 14:08:38.99374222 +0000 UTC m=+121.007293427" watchObservedRunningTime="2026-05-20 14:08:38.994032337 +0000 UTC m=+121.007583533" May 20 14:08:39.016169 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:39.016061 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j9rp9" podStartSLOduration=2.00698199 podStartE2EDuration="5.016052014s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="2026-05-20 14:08:35.315461844 +0000 UTC m=+117.329013017" lastFinishedPulling="2026-05-20 14:08:38.324531857 +0000 UTC m=+120.338083041" observedRunningTime="2026-05-20 14:08:39.01592234 +0000 UTC m=+121.029473559" watchObservedRunningTime="2026-05-20 14:08:39.016052014 +0000 UTC m=+121.029603209" May 20 14:08:45.659024 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.658992 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p4fd5"] May 20 14:08:45.664233 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.664213 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.667043 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.666886 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 14:08:45.667043 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.666922 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 14:08:45.667043 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.666936 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d7grx\"" May 20 14:08:45.667237 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.667189 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 14:08:45.668815 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.667955 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 14:08:45.724286 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724253 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-wtmp\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724399 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724301 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724399 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-root\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724399 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724359 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkzd7\" (UniqueName: \"kubernetes.io/projected/126a5903-06fa-49ed-9608-0c5d2a848a48-kube-api-access-kkzd7\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724399 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/126a5903-06fa-49ed-9608-0c5d2a848a48-metrics-client-ca\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724583 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724500 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724625 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-sys\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724661 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-textfile\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.724661 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.724648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-tls\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825324 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825286 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-sys\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825485 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825335 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-textfile\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825485 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825364 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-tls\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825485 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825403 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-wtmp\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825485 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825432 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825485 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825460 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-root\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825754 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825486 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkzd7\" (UniqueName: \"kubernetes.io/projected/126a5903-06fa-49ed-9608-0c5d2a848a48-kube-api-access-kkzd7\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825754 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/126a5903-06fa-49ed-9608-0c5d2a848a48-metrics-client-ca\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825754 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.825606 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.825754 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:45.825669 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 20 14:08:45.825754 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:45.825751 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-tls podName:126a5903-06fa-49ed-9608-0c5d2a848a48 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:46.325730053 +0000 UTC m=+128.339281234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-tls") pod "node-exporter-p4fd5" (UID: "126a5903-06fa-49ed-9608-0c5d2a848a48") : secret "node-exporter-tls" not found May 20 14:08:45.826049 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.826025 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-sys\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.826248 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.826232 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-root\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.826340 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.826246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.826419 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.826307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-textfile\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.826633 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.826617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-wtmp\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.827180 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.826760 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/126a5903-06fa-49ed-9608-0c5d2a848a48-metrics-client-ca\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.834269 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.834220 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:45.841062 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:45.841043 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkzd7\" (UniqueName: \"kubernetes.io/projected/126a5903-06fa-49ed-9608-0c5d2a848a48-kube-api-access-kkzd7\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:46.330111 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.330082 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-tls\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:46.332678 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.332650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/126a5903-06fa-49ed-9608-0c5d2a848a48-node-exporter-tls\") pod \"node-exporter-p4fd5\" (UID: \"126a5903-06fa-49ed-9608-0c5d2a848a48\") " pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:46.576515 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.576467 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4fd5" May 20 14:08:46.584449 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:46.584411 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126a5903_06fa_49ed_9608_0c5d2a848a48.slice/crio-c254dbfb2f01f8861131399cbf59509fc666a615ac195b27feb40bb8cf57618e WatchSource:0}: Error finding container c254dbfb2f01f8861131399cbf59509fc666a615ac195b27feb40bb8cf57618e: Status 404 returned error can't find the container with id c254dbfb2f01f8861131399cbf59509fc666a615ac195b27feb40bb8cf57618e May 20 14:08:46.700194 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.700162 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:08:46.706515 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.706490 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.709130 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709107 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 14:08:46.709250 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709109 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 14:08:46.709315 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709270 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 14:08:46.709492 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709473 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v4btx\"" May 20 14:08:46.709492 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709486 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 14:08:46.709672 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709524 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 14:08:46.709672 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709563 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 14:08:46.709672 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709477 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 14:08:46.709823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.709808 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 14:08:46.712623 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.712609 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 14:08:46.720345 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.720327 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:08:46.733199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733178 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733299 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd6d2\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-kube-api-access-pd6d2\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733299 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733377 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-config-volume\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733377 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-config-out\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733446 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733398 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-web-config\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733483 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733464 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733542 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733578 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733566 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733624 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733624 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733696 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.733760 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.733731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835073 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.834996 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6d2\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-kube-api-access-pd6d2\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835073 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835033 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835073 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835064 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-config-volume\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835335 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835088 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-config-out\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835335 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-web-config\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835335 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835250 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835519 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835378 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.835805 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.835784 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.836289 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.836262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.836433 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.836410 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.836495 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.836466 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.836846 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.836823 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.836929 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.836881 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.837305 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.837282 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.837384 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.837334 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.837771 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.837750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.837998 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.837974 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-config-out\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.838674 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.838155 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.838674 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.838629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-config-volume\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.839570 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.839547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.839744 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.839723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-web-config\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.839830 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.839791 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.839830 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.839809 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.840281 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.840259 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.840566 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.840551 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.843926 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.843905 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd6d2\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-kube-api-access-pd6d2\") pod \"alertmanager-main-0\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:46.991570 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:46.991536 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4fd5" event={"ID":"126a5903-06fa-49ed-9608-0c5d2a848a48","Type":"ContainerStarted","Data":"c254dbfb2f01f8861131399cbf59509fc666a615ac195b27feb40bb8cf57618e"} May 20 14:08:47.017781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:47.017762 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 14:08:47.197851 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:47.197815 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:08:47.201897 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:47.201868 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08466319_d0ec_4065_bd31_1bb14b6a556d.slice/crio-aefe5920d82a5700925f336e6eaac89334a5f67c2a236d260c21d876533abf83 WatchSource:0}: Error finding container aefe5920d82a5700925f336e6eaac89334a5f67c2a236d260c21d876533abf83: Status 404 returned error can't find the container with id aefe5920d82a5700925f336e6eaac89334a5f67c2a236d260c21d876533abf83 May 20 14:08:47.996119 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:47.996083 2555 generic.go:358] "Generic (PLEG): container finished" podID="126a5903-06fa-49ed-9608-0c5d2a848a48" containerID="794b49b225c06795a431b2aca7dcb19609baa5c83ac626b65d919b78d2a19e35" exitCode=0 May 20 14:08:47.996630 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:47.996171 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4fd5" event={"ID":"126a5903-06fa-49ed-9608-0c5d2a848a48","Type":"ContainerDied","Data":"794b49b225c06795a431b2aca7dcb19609baa5c83ac626b65d919b78d2a19e35"} May 20 14:08:47.997428 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:47.997400 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"aefe5920d82a5700925f336e6eaac89334a5f67c2a236d260c21d876533abf83"} May 20 14:08:48.354094 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:48.354062 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:08:48.356184 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:48.356158 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd0dd56-cecd-4f98-a24d-5f18754736d3-metrics-certs\") pod \"network-metrics-daemon-rxsxj\" (UID: \"2cd0dd56-cecd-4f98-a24d-5f18754736d3\") " pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:08:48.381765 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:48.381742 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rhhv\"" May 20 14:08:48.388460 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:48.388447 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxsxj" May 20 14:08:48.525112 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:48.524965 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxsxj"] May 20 14:08:48.527652 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:48.527624 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd0dd56_cecd_4f98_a24d_5f18754736d3.slice/crio-fb03eeb542c1c7982016afa8c0738fc786a2ef32dc408f08c2cbda8690fc5807 WatchSource:0}: Error finding container fb03eeb542c1c7982016afa8c0738fc786a2ef32dc408f08c2cbda8690fc5807: Status 404 returned error can't find the container with id fb03eeb542c1c7982016afa8c0738fc786a2ef32dc408f08c2cbda8690fc5807 May 20 14:08:49.004613 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.004531 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4fd5" event={"ID":"126a5903-06fa-49ed-9608-0c5d2a848a48","Type":"ContainerStarted","Data":"81f36a8ea4fdc68b03bf6fc3447cdbcef5ff7c06677f4a3bb2df4aeec8312662"} May 20 14:08:49.004613 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.004581 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4fd5" event={"ID":"126a5903-06fa-49ed-9608-0c5d2a848a48","Type":"ContainerStarted","Data":"f981dcfa251d6f8b065ed2cea28a56daa076860193c365770398554cd04464b2"} May 20 14:08:49.005566 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.005535 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxsxj" event={"ID":"2cd0dd56-cecd-4f98-a24d-5f18754736d3","Type":"ContainerStarted","Data":"fb03eeb542c1c7982016afa8c0738fc786a2ef32dc408f08c2cbda8690fc5807"} May 20 14:08:49.007031 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.007000 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="e7663645c08edcae489c23d90719e2d4be33dcd53103cce7da5297948d236f85" exitCode=0 May 20 14:08:49.007139 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.007091 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"e7663645c08edcae489c23d90719e2d4be33dcd53103cce7da5297948d236f85"} May 20 14:08:49.037419 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.037353 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p4fd5" podStartSLOduration=3.012388218 podStartE2EDuration="4.037333757s" podCreationTimestamp="2026-05-20 14:08:45 +0000 UTC" firstStartedPulling="2026-05-20 14:08:46.58629599 +0000 UTC m=+128.599847177" lastFinishedPulling="2026-05-20 14:08:47.611241544 +0000 UTC m=+129.624792716" observedRunningTime="2026-05-20 14:08:49.036342831 +0000 UTC m=+131.049894025" watchObservedRunningTime="2026-05-20 14:08:49.037333757 +0000 UTC m=+131.050884953" May 20 14:08:49.955487 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.955401 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-655b6486c-vb4r4"] May 20 14:08:49.958460 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.958440 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.963351 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.963331 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xbqnh\"" May 20 14:08:49.964625 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.964355 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 20 14:08:49.964625 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.964386 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 20 14:08:49.964625 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.964493 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 14:08:49.964625 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.964515 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 20 14:08:49.965084 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.965039 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1siim4s0upgk3\"" May 20 14:08:49.966877 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.966854 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml4w7\" (UniqueName: \"kubernetes.io/projected/6be600d6-6159-453c-aec2-782bccbcd4ed-kube-api-access-ml4w7\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.966976 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.966898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-secret-metrics-server-client-certs\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.966976 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.966950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be600d6-6159-453c-aec2-782bccbcd4ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.967087 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.967024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6be600d6-6159-453c-aec2-782bccbcd4ed-audit-log\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.967087 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.967071 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-client-ca-bundle\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.967188 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.967110 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6be600d6-6159-453c-aec2-782bccbcd4ed-metrics-server-audit-profiles\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.967188 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.967172 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-secret-metrics-server-tls\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:49.985943 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:49.985921 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-655b6486c-vb4r4"] May 20 14:08:50.012146 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.012114 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxsxj" event={"ID":"2cd0dd56-cecd-4f98-a24d-5f18754736d3","Type":"ContainerStarted","Data":"e31aeec029780027d0e2c4cc9e9a2c74ae81d9457044cf915a34661cc3c6bfdc"} May 20 14:08:50.012558 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.012153 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxsxj" event={"ID":"2cd0dd56-cecd-4f98-a24d-5f18754736d3","Type":"ContainerStarted","Data":"565b3cfc49a1ff8a52138134abcffa059914bbe963440019f1e4a30ad3169e6b"} May 20 14:08:50.048574 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.048492 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxsxj" podStartSLOduration=131.03726636 podStartE2EDuration="2m12.048477852s" podCreationTimestamp="2026-05-20 14:06:38 +0000 UTC" firstStartedPulling="2026-05-20 14:08:48.529639594 +0000 UTC m=+130.543190770" lastFinishedPulling="2026-05-20 14:08:49.540851073 +0000 UTC m=+131.554402262" observedRunningTime="2026-05-20 14:08:50.04624015 +0000 UTC m=+132.059791372" watchObservedRunningTime="2026-05-20 14:08:50.048477852 +0000 UTC m=+132.062029046" May 20 14:08:50.067730 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.067694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6be600d6-6159-453c-aec2-782bccbcd4ed-audit-log\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.067843 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.067742 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-client-ca-bundle\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.067843 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.067770 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6be600d6-6159-453c-aec2-782bccbcd4ed-metrics-server-audit-profiles\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068064 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068038 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-secret-metrics-server-tls\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068206 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068082 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ml4w7\" (UniqueName: \"kubernetes.io/projected/6be600d6-6159-453c-aec2-782bccbcd4ed-kube-api-access-ml4w7\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068206 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068142 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-secret-metrics-server-client-certs\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068218 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be600d6-6159-453c-aec2-782bccbcd4ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068371 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068322 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6be600d6-6159-453c-aec2-782bccbcd4ed-audit-log\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068859 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068837 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be600d6-6159-453c-aec2-782bccbcd4ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.068970 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.068875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6be600d6-6159-453c-aec2-782bccbcd4ed-metrics-server-audit-profiles\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.070558 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.070530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-secret-metrics-server-client-certs\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.070642 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.070611 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-secret-metrics-server-tls\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.070680 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.070654 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6be600d6-6159-453c-aec2-782bccbcd4ed-client-ca-bundle\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.083895 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.083874 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml4w7\" (UniqueName: \"kubernetes.io/projected/6be600d6-6159-453c-aec2-782bccbcd4ed-kube-api-access-ml4w7\") pod \"metrics-server-655b6486c-vb4r4\" (UID: \"6be600d6-6159-453c-aec2-782bccbcd4ed\") " pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.269804 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.269756 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:08:50.441181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.441149 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx"] May 20 14:08:50.444885 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.444863 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:50.447750 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.447727 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 20 14:08:50.448011 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.447913 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-rhxf9\"" May 20 14:08:50.458591 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.458566 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx"] May 20 14:08:50.471425 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.471401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gbfxx\" (UID: \"73bac66f-522b-4720-bb40-cac4cff8f754\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:50.571994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.571964 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gbfxx\" (UID: \"73bac66f-522b-4720-bb40-cac4cff8f754\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:50.572140 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:50.572119 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 20 14:08:50.572210 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:50.572187 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert podName:73bac66f-522b-4720-bb40-cac4cff8f754 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:51.072170038 +0000 UTC m=+133.085721220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-gbfxx" (UID: "73bac66f-522b-4720-bb40-cac4cff8f754") : secret "monitoring-plugin-cert" not found May 20 14:08:50.624410 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:50.624385 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-655b6486c-vb4r4"] May 20 14:08:50.628541 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:50.628488 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be600d6_6159_453c_aec2_782bccbcd4ed.slice/crio-fad8be8e59a7f60995c3a78eb8d7f4830d44a112148857890777366c2d7db667 WatchSource:0}: Error finding container fad8be8e59a7f60995c3a78eb8d7f4830d44a112148857890777366c2d7db667: Status 404 returned error can't find the container with id fad8be8e59a7f60995c3a78eb8d7f4830d44a112148857890777366c2d7db667 May 20 14:08:51.015941 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.015905 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" event={"ID":"6be600d6-6159-453c-aec2-782bccbcd4ed","Type":"ContainerStarted","Data":"fad8be8e59a7f60995c3a78eb8d7f4830d44a112148857890777366c2d7db667"} May 20 14:08:51.018569 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.018542 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"8d917db5d2da0597da8bd59a3d164af988899de1969af687d2d8ff93fdbf8a48"} May 20 14:08:51.018673 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.018577 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"9f395c066fc4e5fcf53f0a2f5fbb099f74e7bd8398490b5175209abcb1d7d164"} May 20 14:08:51.018673 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.018595 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"6719c15945e0c1bea4a9d5ed724660b625ae1128e5c09f5063a60cffac207e96"} May 20 14:08:51.018673 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.018607 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"42495d74d73d636fddcb854d2b79adc74959788131da9588b167b9eb297eb568"} May 20 14:08:51.018673 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.018633 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"55cc5dd0a6e0e64e12f0a834e6f2d7d0673ad39f3e0282c95b4a08e69ad0127d"} May 20 14:08:51.075979 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.075908 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gbfxx\" (UID: \"73bac66f-522b-4720-bb40-cac4cff8f754\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:51.076105 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:51.076017 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 20 14:08:51.076105 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:51.076095 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert podName:73bac66f-522b-4720-bb40-cac4cff8f754 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:52.076074199 +0000 UTC m=+134.089625392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-gbfxx" (UID: "73bac66f-522b-4720-bb40-cac4cff8f754") : secret "monitoring-plugin-cert" not found May 20 14:08:51.941217 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.941180 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:08:51.945200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.945179 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.948024 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948000 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-jt01unkocepv\"" May 20 14:08:51.948138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948098 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 14:08:51.948368 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948345 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 14:08:51.948454 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948361 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 14:08:51.948454 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948396 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 14:08:51.948610 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948448 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 14:08:51.948936 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948917 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 14:08:51.948936 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948927 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 14:08:51.949079 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.948927 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 14:08:51.949243 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.949195 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 14:08:51.949339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.949275 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 14:08:51.949588 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.949568 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 14:08:51.949721 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.949706 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s48p6\"" May 20 14:08:51.954992 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.953263 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 14:08:51.965023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.964943 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:08:51.983810 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.983784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.983962 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.983828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.983962 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.983848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.983962 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.983926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984069 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.983964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984069 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.983985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984069 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984012 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjn5\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-kube-api-access-hxjn5\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984159 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984159 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984221 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-config\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984271 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984306 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984350 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984305 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984405 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984384 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984459 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984423 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984459 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984593 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:51.984593 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:51.984519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.085693 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085671 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085711 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085731 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085748 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085801 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085856 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjn5\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-kube-api-access-hxjn5\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085877 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085899 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086023 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.085934 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-config\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086031 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086058 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086080 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086145 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086177 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086205 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086235 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gbfxx\" (UID: \"73bac66f-522b-4720-bb40-cac4cff8f754\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086262 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086291 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.086464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.086421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.088239 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.088211 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.088759 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.088606 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.088759 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.088683 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.088900 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.088796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.088962 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.088897 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.088962 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.088945 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-config\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.089737 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.089142 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.089737 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.089535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.089737 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.089670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.089944 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.089807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.089944 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.089822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.090713 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.090672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.091729 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.091701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73bac66f-522b-4720-bb40-cac4cff8f754-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gbfxx\" (UID: \"73bac66f-522b-4720-bb40-cac4cff8f754\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:52.091919 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.091899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.092015 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.091998 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.092117 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.092090 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.092485 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.092468 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.101370 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.101349 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjn5\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-kube-api-access-hxjn5\") pod \"prometheus-k8s-0\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.256825 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.256796 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:52.258615 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.258596 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:08:52.418258 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.418228 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx"] May 20 14:08:52.419642 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:52.419615 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bac66f_522b_4720_bb40_cac4cff8f754.slice/crio-38b1a8eb01bd6d470e5d236832d80a6adba821dced5331e3d36bbd351ce24c9f WatchSource:0}: Error finding container 38b1a8eb01bd6d470e5d236832d80a6adba821dced5331e3d36bbd351ce24c9f: Status 404 returned error can't find the container with id 38b1a8eb01bd6d470e5d236832d80a6adba821dced5331e3d36bbd351ce24c9f May 20 14:08:52.446072 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:52.445973 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:08:52.448373 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:08:52.448346 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d70d30e_b444_473d_bee2_5a15906ab93b.slice/crio-06f2996aad6974a6897791ae7cd23ad1de5ecea26a2976e2945b5311b453819c WatchSource:0}: Error finding container 06f2996aad6974a6897791ae7cd23ad1de5ecea26a2976e2945b5311b453819c: Status 404 returned error can't find the container with id 06f2996aad6974a6897791ae7cd23ad1de5ecea26a2976e2945b5311b453819c May 20 14:08:53.026848 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.026782 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" exitCode=0 May 20 14:08:53.027091 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.026873 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} May 20 14:08:53.027091 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.026916 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"06f2996aad6974a6897791ae7cd23ad1de5ecea26a2976e2945b5311b453819c"} May 20 14:08:53.028410 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.028386 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" event={"ID":"73bac66f-522b-4720-bb40-cac4cff8f754","Type":"ContainerStarted","Data":"38b1a8eb01bd6d470e5d236832d80a6adba821dced5331e3d36bbd351ce24c9f"} May 20 14:08:53.031892 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.031867 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerStarted","Data":"77b3e780514a5a2b62be8619bd6d90a6f721f2e4aff917c37659f431c9b07fdf"} May 20 14:08:53.033560 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.033526 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" event={"ID":"6be600d6-6159-453c-aec2-782bccbcd4ed","Type":"ContainerStarted","Data":"3d8f973227f8ba6137e9f1b28fc6d629048e52356d22ce028a0dc54a7fa1a97f"} May 20 14:08:53.091855 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.091765 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" podStartSLOduration=2.677428853 podStartE2EDuration="4.091747757s" podCreationTimestamp="2026-05-20 14:08:49 +0000 UTC" firstStartedPulling="2026-05-20 14:08:50.630167638 +0000 UTC m=+132.643718812" lastFinishedPulling="2026-05-20 14:08:52.044486527 +0000 UTC m=+134.058037716" observedRunningTime="2026-05-20 14:08:53.09137963 +0000 UTC m=+135.104930821" watchObservedRunningTime="2026-05-20 14:08:53.091747757 +0000 UTC m=+135.105298956" May 20 14:08:53.131069 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:53.130956 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2899413060000002 podStartE2EDuration="7.130937518s" podCreationTimestamp="2026-05-20 14:08:46 +0000 UTC" firstStartedPulling="2026-05-20 14:08:47.204100266 +0000 UTC m=+129.217651484" lastFinishedPulling="2026-05-20 14:08:52.045096522 +0000 UTC m=+134.058647696" observedRunningTime="2026-05-20 14:08:53.129834172 +0000 UTC m=+135.143385367" watchObservedRunningTime="2026-05-20 14:08:53.130937518 +0000 UTC m=+135.144488712" May 20 14:08:54.038294 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:54.038248 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" event={"ID":"73bac66f-522b-4720-bb40-cac4cff8f754","Type":"ContainerStarted","Data":"b88438f6bee312e5d0ce04f2a1bffc02aab2374f5a17f7f663e63d97adae60ba"} May 20 14:08:54.074113 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:54.074053 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" podStartSLOduration=2.845990329 podStartE2EDuration="4.074033966s" podCreationTimestamp="2026-05-20 14:08:50 +0000 UTC" firstStartedPulling="2026-05-20 14:08:52.421597402 +0000 UTC m=+134.435148581" lastFinishedPulling="2026-05-20 14:08:53.649641042 +0000 UTC m=+135.663192218" observedRunningTime="2026-05-20 14:08:54.073332191 +0000 UTC m=+136.086883387" watchObservedRunningTime="2026-05-20 14:08:54.074033966 +0000 UTC m=+136.087585165" May 20 14:08:55.042985 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:55.042951 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:55.048319 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:55.048292 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gbfxx" May 20 14:08:56.047645 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:56.047608 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} May 20 14:08:56.048016 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:56.047654 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} May 20 14:08:57.249309 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:57.249278 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dd57949f7-lklbt"] May 20 14:08:57.249763 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:08:57.249554 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" podUID="f34c2128-c8c0-4f11-95ee-f7ddb996a461" May 20 14:08:58.056030 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.055994 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} May 20 14:08:58.056207 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.056038 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} May 20 14:08:58.056207 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.056052 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} May 20 14:08:58.056207 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.056061 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerStarted","Data":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} May 20 14:08:58.056207 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.056012 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:08:58.060175 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.060158 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:08:58.096564 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.096520 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.410601238 podStartE2EDuration="7.096489139s" podCreationTimestamp="2026-05-20 14:08:51 +0000 UTC" firstStartedPulling="2026-05-20 14:08:53.028378081 +0000 UTC m=+135.041929268" lastFinishedPulling="2026-05-20 14:08:57.714265984 +0000 UTC m=+139.727817169" observedRunningTime="2026-05-20 14:08:58.095414753 +0000 UTC m=+140.108966005" watchObservedRunningTime="2026-05-20 14:08:58.096489139 +0000 UTC m=+140.110040390" May 20 14:08:58.144462 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144440 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34c2128-c8c0-4f11-95ee-f7ddb996a461-ca-trust-extracted\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144480 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-certificates\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144534 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-bound-sa-token\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144562 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-image-registry-private-configuration\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144623 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-installation-pull-secrets\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144651 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-trusted-ca\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144682 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxgq4\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-kube-api-access-sxgq4\") pod \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\" (UID: \"f34c2128-c8c0-4f11-95ee-f7ddb996a461\") " May 20 14:08:58.144745 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144687 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34c2128-c8c0-4f11-95ee-f7ddb996a461-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:08:58.145112 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.144879 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:08:58.145112 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.145025 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:08:58.145206 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.145191 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34c2128-c8c0-4f11-95ee-f7ddb996a461-ca-trust-extracted\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:58.145260 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.145211 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-certificates\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:58.145260 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.145227 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34c2128-c8c0-4f11-95ee-f7ddb996a461-trusted-ca\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:58.153068 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.147366 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-kube-api-access-sxgq4" (OuterVolumeSpecName: "kube-api-access-sxgq4") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "kube-api-access-sxgq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:08:58.153068 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.147539 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:08:58.153068 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.147670 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:08:58.153068 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.147836 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f34c2128-c8c0-4f11-95ee-f7ddb996a461" (UID: "f34c2128-c8c0-4f11-95ee-f7ddb996a461"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:08:58.245634 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.245605 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-bound-sa-token\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:58.245634 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.245629 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-image-registry-private-configuration\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:58.245778 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.245640 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34c2128-c8c0-4f11-95ee-f7ddb996a461-installation-pull-secrets\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:58.245778 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:58.245649 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxgq4\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-kube-api-access-sxgq4\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:08:59.058693 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:59.058658 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd57949f7-lklbt" May 20 14:08:59.104719 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:59.104689 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dd57949f7-lklbt"] May 20 14:08:59.109407 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:59.109384 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dd57949f7-lklbt"] May 20 14:08:59.153259 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:08:59.153236 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34c2128-c8c0-4f11-95ee-f7ddb996a461-registry-tls\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:09:00.572338 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:00.572289 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34c2128-c8c0-4f11-95ee-f7ddb996a461" path="/var/lib/kubelet/pods/f34c2128-c8c0-4f11-95ee-f7ddb996a461/volumes" May 20 14:09:02.259320 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:02.259275 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:09:10.270272 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:10.270225 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:09:10.270272 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:10.270285 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:09:14.102125 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:14.102093 2555 generic.go:358] "Generic (PLEG): container finished" podID="d2382e51-a33d-4642-a843-69fd2b3a7402" containerID="e4275cd884ee51b20dac1421dda2fd9bcc3d2155005d791b514e2d49d93a2cb7" exitCode=0 May 20 14:09:14.102474 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:14.102139 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" event={"ID":"d2382e51-a33d-4642-a843-69fd2b3a7402","Type":"ContainerDied","Data":"e4275cd884ee51b20dac1421dda2fd9bcc3d2155005d791b514e2d49d93a2cb7"} May 20 14:09:14.102474 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:14.102427 2555 scope.go:117] "RemoveContainer" containerID="e4275cd884ee51b20dac1421dda2fd9bcc3d2155005d791b514e2d49d93a2cb7" May 20 14:09:15.106060 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:15.106017 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mslcq" event={"ID":"d2382e51-a33d-4642-a843-69fd2b3a7402","Type":"ContainerStarted","Data":"41a0e4d5ad55b484e192748aa378a46ec1694963221a7cad9c93db76082487bd"} May 20 14:09:15.349993 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:09:15.349953 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-phjjw" podUID="b3f20d64-745b-43eb-ae14-2c56aa915574" May 20 14:09:15.360154 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:09:15.360087 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-9zcc5" podUID="bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f" May 20 14:09:16.108980 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:16.108950 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:09:16.109337 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:16.108951 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phjjw" May 20 14:09:20.245331 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.245288 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:09:20.247607 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.247585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3f20d64-745b-43eb-ae14-2c56aa915574-metrics-tls\") pod \"dns-default-phjjw\" (UID: \"b3f20d64-745b-43eb-ae14-2c56aa915574\") " pod="openshift-dns/dns-default-phjjw" May 20 14:09:20.312964 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.312935 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9jh8\"" May 20 14:09:20.320200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.320177 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phjjw" May 20 14:09:20.346267 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.346239 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:09:20.348876 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.348848 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f-cert\") pod \"ingress-canary-9zcc5\" (UID: \"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f\") " pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:09:20.458806 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.458782 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phjjw"] May 20 14:09:20.461384 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:09:20.461352 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f20d64_745b_43eb_ae14_2c56aa915574.slice/crio-f0cfddb7bc98c9b71c9bced48bb294e67b08d0dbc6c26dff4fffb43bfe561a65 WatchSource:0}: Error finding container f0cfddb7bc98c9b71c9bced48bb294e67b08d0dbc6c26dff4fffb43bfe561a65: Status 404 returned error can't find the container with id f0cfddb7bc98c9b71c9bced48bb294e67b08d0dbc6c26dff4fffb43bfe561a65 May 20 14:09:20.612734 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.612656 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g69fg\"" May 20 14:09:20.620118 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.620100 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zcc5" May 20 14:09:20.745421 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:20.745390 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9zcc5"] May 20 14:09:20.748321 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:09:20.748293 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7c45fe_bb7e_4ae6_b673_2ebeaf85ce5f.slice/crio-68eb665b0e01680054c57db0f3d46b2caafae4df07806ba6d1269d97f405d92d WatchSource:0}: Error finding container 68eb665b0e01680054c57db0f3d46b2caafae4df07806ba6d1269d97f405d92d: Status 404 returned error can't find the container with id 68eb665b0e01680054c57db0f3d46b2caafae4df07806ba6d1269d97f405d92d May 20 14:09:21.125433 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:21.125401 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9zcc5" event={"ID":"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f","Type":"ContainerStarted","Data":"68eb665b0e01680054c57db0f3d46b2caafae4df07806ba6d1269d97f405d92d"} May 20 14:09:21.126247 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:21.126227 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phjjw" event={"ID":"b3f20d64-745b-43eb-ae14-2c56aa915574","Type":"ContainerStarted","Data":"f0cfddb7bc98c9b71c9bced48bb294e67b08d0dbc6c26dff4fffb43bfe561a65"} May 20 14:09:23.133894 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:23.133853 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9zcc5" event={"ID":"bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f","Type":"ContainerStarted","Data":"b81d6edfbef44d92e968266ca8d320565d67b6c9b3f6c1251c455b3cde626497"} May 20 14:09:23.135302 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:23.135281 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phjjw" event={"ID":"b3f20d64-745b-43eb-ae14-2c56aa915574","Type":"ContainerStarted","Data":"08bd3d3d92be8a8db817592704bece4c29cb688c45a22e9eac08f81687e5bafd"} May 20 14:09:23.135385 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:23.135308 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phjjw" event={"ID":"b3f20d64-745b-43eb-ae14-2c56aa915574","Type":"ContainerStarted","Data":"6fb5ef32e9eb77fa91b6542d356fe91960d86e2db1153a821d3e40398a42448d"} May 20 14:09:23.135426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:23.135400 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-phjjw" May 20 14:09:23.152055 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:23.152007 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9zcc5" podStartSLOduration=129.392626445 podStartE2EDuration="2m11.151992936s" podCreationTimestamp="2026-05-20 14:07:12 +0000 UTC" firstStartedPulling="2026-05-20 14:09:20.750103265 +0000 UTC m=+162.763654451" lastFinishedPulling="2026-05-20 14:09:22.509469754 +0000 UTC m=+164.523020942" observedRunningTime="2026-05-20 14:09:23.1515548 +0000 UTC m=+165.165105996" watchObservedRunningTime="2026-05-20 14:09:23.151992936 +0000 UTC m=+165.165544133" May 20 14:09:23.171930 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:23.171881 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-phjjw" podStartSLOduration=129.12944464 podStartE2EDuration="2m11.171862766s" podCreationTimestamp="2026-05-20 14:07:12 +0000 UTC" firstStartedPulling="2026-05-20 14:09:20.463241745 +0000 UTC m=+162.476792930" lastFinishedPulling="2026-05-20 14:09:22.50565987 +0000 UTC m=+164.519211056" observedRunningTime="2026-05-20 14:09:23.170940311 +0000 UTC m=+165.184491508" watchObservedRunningTime="2026-05-20 14:09:23.171862766 +0000 UTC m=+165.185413962" May 20 14:09:30.275899 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:30.275873 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:09:30.280013 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:30.279984 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-655b6486c-vb4r4" May 20 14:09:33.141120 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:33.141083 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-phjjw" May 20 14:09:52.259675 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:52.259642 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:09:52.278956 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:52.278930 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:09:53.243662 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:09:53.243634 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:06.089526 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.089474 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:10:06.090082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.089912 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="alertmanager" containerID="cri-o://55cc5dd0a6e0e64e12f0a834e6f2d7d0673ad39f3e0282c95b4a08e69ad0127d" gracePeriod=120 May 20 14:10:06.090082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.089960 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-metric" containerID="cri-o://8d917db5d2da0597da8bd59a3d164af988899de1969af687d2d8ff93fdbf8a48" gracePeriod=120 May 20 14:10:06.090082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.090016 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-web" containerID="cri-o://6719c15945e0c1bea4a9d5ed724660b625ae1128e5c09f5063a60cffac207e96" gracePeriod=120 May 20 14:10:06.090082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.090015 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="prom-label-proxy" containerID="cri-o://77b3e780514a5a2b62be8619bd6d90a6f721f2e4aff917c37659f431c9b07fdf" gracePeriod=120 May 20 14:10:06.090082 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.090039 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="config-reloader" containerID="cri-o://42495d74d73d636fddcb854d2b79adc74959788131da9588b167b9eb297eb568" gracePeriod=120 May 20 14:10:06.090327 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.090119 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy" containerID="cri-o://9f395c066fc4e5fcf53f0a2f5fbb099f74e7bd8398490b5175209abcb1d7d164" gracePeriod=120 May 20 14:10:06.272616 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272585 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="77b3e780514a5a2b62be8619bd6d90a6f721f2e4aff917c37659f431c9b07fdf" exitCode=0 May 20 14:10:06.272616 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272611 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="9f395c066fc4e5fcf53f0a2f5fbb099f74e7bd8398490b5175209abcb1d7d164" exitCode=0 May 20 14:10:06.272616 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272618 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="42495d74d73d636fddcb854d2b79adc74959788131da9588b167b9eb297eb568" exitCode=0 May 20 14:10:06.272812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272627 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="55cc5dd0a6e0e64e12f0a834e6f2d7d0673ad39f3e0282c95b4a08e69ad0127d" exitCode=0 May 20 14:10:06.272812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272660 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"77b3e780514a5a2b62be8619bd6d90a6f721f2e4aff917c37659f431c9b07fdf"} May 20 14:10:06.272812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272693 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"9f395c066fc4e5fcf53f0a2f5fbb099f74e7bd8398490b5175209abcb1d7d164"} May 20 14:10:06.272812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272703 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"42495d74d73d636fddcb854d2b79adc74959788131da9588b167b9eb297eb568"} May 20 14:10:06.272812 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:06.272712 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"55cc5dd0a6e0e64e12f0a834e6f2d7d0673ad39f3e0282c95b4a08e69ad0127d"} May 20 14:10:07.279549 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.279498 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="8d917db5d2da0597da8bd59a3d164af988899de1969af687d2d8ff93fdbf8a48" exitCode=0 May 20 14:10:07.279549 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.279537 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"8d917db5d2da0597da8bd59a3d164af988899de1969af687d2d8ff93fdbf8a48"} May 20 14:10:07.279910 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.279585 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"6719c15945e0c1bea4a9d5ed724660b625ae1128e5c09f5063a60cffac207e96"} May 20 14:10:07.279910 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.279551 2555 generic.go:358] "Generic (PLEG): container finished" podID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerID="6719c15945e0c1bea4a9d5ed724660b625ae1128e5c09f5063a60cffac207e96" exitCode=0 May 20 14:10:07.331831 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.331812 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:07.422993 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.422913 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-main-db\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.422993 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.422948 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-config-out\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.422993 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.422978 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-metrics-client-ca\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.422999 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-trusted-ca-bundle\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423027 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-tls-assets\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423047 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423063 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-cluster-tls-config\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423098 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-main-tls\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423128 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-web-config\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423159 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-web\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423201 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423191 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd6d2\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-kube-api-access-pd6d2\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423537 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423238 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-config-volume\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423537 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423256 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:10:07.423537 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423281 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"08466319-d0ec-4065-bd31-1bb14b6a556d\" (UID: \"08466319-d0ec-4065-bd31-1bb14b6a556d\") " May 20 14:10:07.423537 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423425 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:07.423746 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423587 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-main-db\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.423746 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.423616 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.424143 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.424112 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:07.425795 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.425749 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-config-out" (OuterVolumeSpecName: "config-out") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:10:07.426453 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.426427 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-config-volume" (OuterVolumeSpecName: "config-volume") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.426578 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.426530 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:10:07.426652 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.426570 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.426809 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.426778 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-kube-api-access-pd6d2" (OuterVolumeSpecName: "kube-api-access-pd6d2") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "kube-api-access-pd6d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:10:07.426944 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.426919 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.427024 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.426979 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.427869 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.427846 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.430460 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.430350 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.436341 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.436317 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-web-config" (OuterVolumeSpecName: "web-config") pod "08466319-d0ec-4065-bd31-1bb14b6a556d" (UID: "08466319-d0ec-4065-bd31-1bb14b6a556d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:07.524875 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524849 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-config-volume\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.524875 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524872 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.524875 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524882 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08466319-d0ec-4065-bd31-1bb14b6a556d-config-out\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524892 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08466319-d0ec-4065-bd31-1bb14b6a556d-metrics-client-ca\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524902 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-tls-assets\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524911 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524921 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-cluster-tls-config\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524930 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-main-tls\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524938 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-web-config\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524947 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08466319-d0ec-4065-bd31-1bb14b6a556d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:07.525044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:07.524955 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd6d2\" (UniqueName: \"kubernetes.io/projected/08466319-d0ec-4065-bd31-1bb14b6a556d-kube-api-access-pd6d2\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:08.285707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.285675 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08466319-d0ec-4065-bd31-1bb14b6a556d","Type":"ContainerDied","Data":"aefe5920d82a5700925f336e6eaac89334a5f67c2a236d260c21d876533abf83"} May 20 14:10:08.286081 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.285728 2555 scope.go:117] "RemoveContainer" containerID="77b3e780514a5a2b62be8619bd6d90a6f721f2e4aff917c37659f431c9b07fdf" May 20 14:10:08.286081 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.285756 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.292778 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.292757 2555 scope.go:117] "RemoveContainer" containerID="8d917db5d2da0597da8bd59a3d164af988899de1969af687d2d8ff93fdbf8a48" May 20 14:10:08.299703 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.299688 2555 scope.go:117] "RemoveContainer" containerID="9f395c066fc4e5fcf53f0a2f5fbb099f74e7bd8398490b5175209abcb1d7d164" May 20 14:10:08.305571 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.305549 2555 scope.go:117] "RemoveContainer" containerID="6719c15945e0c1bea4a9d5ed724660b625ae1128e5c09f5063a60cffac207e96" May 20 14:10:08.310342 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.310210 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:10:08.314046 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.314013 2555 scope.go:117] "RemoveContainer" containerID="42495d74d73d636fddcb854d2b79adc74959788131da9588b167b9eb297eb568" May 20 14:10:08.315634 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.315609 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:10:08.322825 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.322811 2555 scope.go:117] "RemoveContainer" containerID="55cc5dd0a6e0e64e12f0a834e6f2d7d0673ad39f3e0282c95b4a08e69ad0127d" May 20 14:10:08.328627 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.328613 2555 scope.go:117] "RemoveContainer" containerID="e7663645c08edcae489c23d90719e2d4be33dcd53103cce7da5297948d236f85" May 20 14:10:08.341735 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.341714 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:10:08.342099 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342078 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="config-reloader" May 20 14:10:08.342099 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342100 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="config-reloader" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342110 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-metric" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342119 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-metric" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342135 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="prom-label-proxy" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342143 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="prom-label-proxy" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342155 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="alertmanager" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342162 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="alertmanager" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342171 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-web" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342179 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-web" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342197 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="init-config-reloader" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342202 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="init-config-reloader" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342209 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy" May 20 14:10:08.342242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342214 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy" May 20 14:10:08.342699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342273 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="alertmanager" May 20 14:10:08.342699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342281 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-web" May 20 14:10:08.342699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342288 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy-metric" May 20 14:10:08.342699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342296 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="config-reloader" May 20 14:10:08.342699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342303 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="kube-rbac-proxy" May 20 14:10:08.342699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.342309 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" containerName="prom-label-proxy" May 20 14:10:08.347735 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.347714 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.350455 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350435 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 14:10:08.350657 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350637 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 14:10:08.350732 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350711 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 14:10:08.350796 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350746 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 14:10:08.351106 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350935 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 14:10:08.351106 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350969 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 14:10:08.351106 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350996 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v4btx\"" May 20 14:10:08.351106 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.351010 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 14:10:08.351106 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.350969 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 14:10:08.355712 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.355691 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 14:10:08.359997 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.359973 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:10:08.431238 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9365257e-be7d-464b-927a-5a64957461de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431238 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431223 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431377 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9365257e-be7d-464b-927a-5a64957461de-config-out\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431377 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-web-config\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431377 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431306 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-config-volume\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431472 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431472 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431440 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9365257e-be7d-464b-927a-5a64957461de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431472 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431583 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431583 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl45w\" (UniqueName: \"kubernetes.io/projected/9365257e-be7d-464b-927a-5a64957461de-kube-api-access-dl45w\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431583 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431569 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9365257e-be7d-464b-927a-5a64957461de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431668 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431592 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.431668 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.431629 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365257e-be7d-464b-927a-5a64957461de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.532967 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.532934 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9365257e-be7d-464b-927a-5a64957461de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533144 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.532978 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533144 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365257e-be7d-464b-927a-5a64957461de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533144 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533038 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9365257e-be7d-464b-927a-5a64957461de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533144 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533093 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533344 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533155 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9365257e-be7d-464b-927a-5a64957461de-config-out\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533344 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533199 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-web-config\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533344 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533225 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-config-volume\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533344 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533321 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9365257e-be7d-464b-927a-5a64957461de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533589 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533437 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533589 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533487 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9365257e-be7d-464b-927a-5a64957461de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533589 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533541 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533589 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533566 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533777 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533594 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl45w\" (UniqueName: \"kubernetes.io/projected/9365257e-be7d-464b-927a-5a64957461de-kube-api-access-dl45w\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.533835 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.533784 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365257e-be7d-464b-927a-5a64957461de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.534657 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.534608 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9365257e-be7d-464b-927a-5a64957461de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.536061 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.536034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9365257e-be7d-464b-927a-5a64957461de-config-out\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.536207 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.536180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.536462 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.536442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.536574 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.536535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.537021 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.536994 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.537167 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.537145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-web-config\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.537167 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.537154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.537278 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.537249 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9365257e-be7d-464b-927a-5a64957461de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.537451 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.537429 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9365257e-be7d-464b-927a-5a64957461de-config-volume\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.542217 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.542197 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl45w\" (UniqueName: \"kubernetes.io/projected/9365257e-be7d-464b-927a-5a64957461de-kube-api-access-dl45w\") pod \"alertmanager-main-0\" (UID: \"9365257e-be7d-464b-927a-5a64957461de\") " pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.571851 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.571825 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08466319-d0ec-4065-bd31-1bb14b6a556d" path="/var/lib/kubelet/pods/08466319-d0ec-4065-bd31-1bb14b6a556d/volumes" May 20 14:10:08.657843 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.657810 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 14:10:08.799358 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:08.799332 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 14:10:08.801309 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:10:08.801280 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9365257e_be7d_464b_927a_5a64957461de.slice/crio-c673171888bc6cc734b26e3d84b7d8acab7a19c12028244b476fe56c73c99d1a WatchSource:0}: Error finding container c673171888bc6cc734b26e3d84b7d8acab7a19c12028244b476fe56c73c99d1a: Status 404 returned error can't find the container with id c673171888bc6cc734b26e3d84b7d8acab7a19c12028244b476fe56c73c99d1a May 20 14:10:09.292681 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:09.292646 2555 generic.go:358] "Generic (PLEG): container finished" podID="9365257e-be7d-464b-927a-5a64957461de" containerID="32a410258e6943ed1216e25ffac6dc07546aaf7f21e89bd7c3f8c57a88ce6156" exitCode=0 May 20 14:10:09.293121 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:09.292730 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerDied","Data":"32a410258e6943ed1216e25ffac6dc07546aaf7f21e89bd7c3f8c57a88ce6156"} May 20 14:10:09.293121 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:09.292770 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"c673171888bc6cc734b26e3d84b7d8acab7a19c12028244b476fe56c73c99d1a"} May 20 14:10:10.298542 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.298490 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"32115c3928455554a68f7979c9b139caef550860f67871d9a62f809f7b9298b7"} May 20 14:10:10.298542 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.298543 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"23f56e4b10297dfa0edee6f1eccc30b17abcaeedd819315ea174555f6d9e73c0"} May 20 14:10:10.298904 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.298555 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"fee1d87bcbc55146584dab25b787fdb00d735af4cc11aeb844fec74385ae7160"} May 20 14:10:10.298904 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.298564 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"bac298f1f754a697d05a4e7d41bdf92224bf94c8de036f4b522335cb1fa7a412"} May 20 14:10:10.298904 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.298571 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"fd795a4e2681ba22826e05f520124f2c4ae72c0c9725a4e8f8c84ca786ec3557"} May 20 14:10:10.298904 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.298578 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365257e-be7d-464b-927a-5a64957461de","Type":"ContainerStarted","Data":"cc185967d08afda70344c6a249b614984f926a67d989a39b9a4329de7d56c6a6"} May 20 14:10:10.316659 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.316629 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:10.317078 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.317049 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="prometheus" containerID="cri-o://bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" gracePeriod=600 May 20 14:10:10.317203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.317077 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-web" containerID="cri-o://59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" gracePeriod=600 May 20 14:10:10.317203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.317096 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="config-reloader" containerID="cri-o://967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" gracePeriod=600 May 20 14:10:10.317203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.317083 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy" containerID="cri-o://f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" gracePeriod=600 May 20 14:10:10.317203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.317077 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" gracePeriod=600 May 20 14:10:10.317203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.317084 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="thanos-sidecar" containerID="cri-o://d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" gracePeriod=600 May 20 14:10:10.336189 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.336144 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.336129474 podStartE2EDuration="2.336129474s" podCreationTimestamp="2026-05-20 14:10:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:10:10.334087551 +0000 UTC m=+212.347638745" watchObservedRunningTime="2026-05-20 14:10:10.336129474 +0000 UTC m=+212.349680668" May 20 14:10:10.551861 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.551811 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:10.652037 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652009 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-trusted-ca-bundle\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652037 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652042 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-config-out\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652262 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652074 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-tls\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652262 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652186 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-tls-assets\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652262 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652252 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-metrics-client-certs\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652420 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652286 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652420 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652305 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-db\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652420 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652344 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-rulefiles-0\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652420 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652367 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-grpc-tls\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652420 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652402 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxjn5\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-kube-api-access-hxjn5\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652697 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652463 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652697 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652465 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:10.652697 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652563 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-kubelet-serving-ca-bundle\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652697 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652597 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-serving-certs-ca-bundle\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652697 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652627 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-metrics-client-ca\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652697 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652657 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-thanos-prometheus-http-client-file\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652983 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652705 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-kube-rbac-proxy\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652983 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652737 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-web-config\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.652983 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.652763 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-config\") pod \"8d70d30e-b444-473d-bee2-5a15906ab93b\" (UID: \"8d70d30e-b444-473d-bee2-5a15906ab93b\") " May 20 14:10:10.653130 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.653003 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.653928 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.653895 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:10:10.654363 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.654335 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:10.655331 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.655300 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:10.655412 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.655380 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:10.655944 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.655907 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.656034 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.655943 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.656034 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.655963 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.656034 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.655998 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:10:10.656215 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.656191 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-config" (OuterVolumeSpecName: "config") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.656354 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.656316 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-config-out" (OuterVolumeSpecName: "config-out") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:10:10.656580 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.656556 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:10.656741 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.656715 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.656807 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.656788 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-kube-api-access-hxjn5" (OuterVolumeSpecName: "kube-api-access-hxjn5") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "kube-api-access-hxjn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:10:10.657772 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.657745 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.657871 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.657774 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.658048 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.658025 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.667464 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.667443 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-web-config" (OuterVolumeSpecName: "web-config") pod "8d70d30e-b444-473d-bee2-5a15906ab93b" (UID: "8d70d30e-b444-473d-bee2-5a15906ab93b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:10.753851 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753826 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.753851 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753851 2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-grpc-tls\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753866 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxjn5\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-kube-api-access-hxjn5\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753879 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753893 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753907 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753920 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d70d30e-b444-473d-bee2-5a15906ab93b-configmap-metrics-client-ca\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753934 2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753949 2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-kube-rbac-proxy\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753961 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-web-config\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753974 2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-config\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.753987 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-config-out\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.754000 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.754015 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d70d30e-b444-473d-bee2-5a15906ab93b-tls-assets\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754376 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.754030 2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-metrics-client-certs\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754376 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.754045 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d70d30e-b444-473d-bee2-5a15906ab93b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:10.754376 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:10.754061 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d70d30e-b444-473d-bee2-5a15906ab93b-prometheus-k8s-db\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:10:11.304415 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304386 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" exitCode=0 May 20 14:10:11.304415 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304412 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" exitCode=0 May 20 14:10:11.304415 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304420 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" exitCode=0 May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304428 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" exitCode=0 May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304435 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" exitCode=0 May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304442 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" exitCode=0 May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304470 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304492 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304522 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304535 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304548 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304551 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304640 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304655 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} May 20 14:10:11.304994 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.304668 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d70d30e-b444-473d-bee2-5a15906ab93b","Type":"ContainerDied","Data":"06f2996aad6974a6897791ae7cd23ad1de5ecea26a2976e2945b5311b453819c"} May 20 14:10:11.312604 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.312373 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.319413 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.319263 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.325277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.325264 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.328660 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.328489 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:11.332038 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.332021 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.334933 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.334906 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:11.338590 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.338574 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.345097 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.345081 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.350875 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.350858 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.351119 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.351101 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.351161 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351126 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} err="failed to get container status \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" May 20 14:10:11.351161 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351156 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.351396 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.351378 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.351439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351403 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} err="failed to get container status \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" May 20 14:10:11.351439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351419 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.351655 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.351638 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.351712 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351659 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} err="failed to get container status \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" May 20 14:10:11.351712 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351674 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.351899 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.351881 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.351937 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351903 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} err="failed to get container status \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" May 20 14:10:11.351937 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.351917 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.352135 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.352121 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.352185 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352137 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} err="failed to get container status \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" May 20 14:10:11.352185 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352152 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.352367 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.352352 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.352411 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352371 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} err="failed to get container status \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" May 20 14:10:11.352411 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352385 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.352631 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:10:11.352613 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.352689 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352636 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} err="failed to get container status \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" May 20 14:10:11.352689 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352650 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.352862 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352841 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} err="failed to get container status \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" May 20 14:10:11.352901 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.352862 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.353055 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353038 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} err="failed to get container status \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" May 20 14:10:11.353095 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353056 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.353262 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353246 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} err="failed to get container status \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" May 20 14:10:11.353262 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353261 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.353446 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353431 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} err="failed to get container status \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" May 20 14:10:11.353486 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353446 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.353686 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353668 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} err="failed to get container status \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" May 20 14:10:11.353738 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353686 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.353868 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353852 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} err="failed to get container status \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" May 20 14:10:11.353910 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.353869 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.354077 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354057 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} err="failed to get container status \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" May 20 14:10:11.354142 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354079 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.354315 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354297 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} err="failed to get container status \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" May 20 14:10:11.354364 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354316 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.354536 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354496 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} err="failed to get container status \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" May 20 14:10:11.354536 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354536 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.354744 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354726 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} err="failed to get container status \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" May 20 14:10:11.354814 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354745 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.354970 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354949 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} err="failed to get container status \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" May 20 14:10:11.355019 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.354973 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.355178 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355161 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} err="failed to get container status \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" May 20 14:10:11.355228 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355179 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.355387 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355369 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} err="failed to get container status \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" May 20 14:10:11.355452 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355388 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.355608 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355589 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} err="failed to get container status \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" May 20 14:10:11.355608 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355607 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.355773 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355758 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} err="failed to get container status \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" May 20 14:10:11.355818 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355773 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.355921 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355905 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} err="failed to get container status \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" May 20 14:10:11.355968 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.355921 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.356068 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356051 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} err="failed to get container status \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" May 20 14:10:11.356110 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356069 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.356241 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356221 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} err="failed to get container status \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" May 20 14:10:11.356275 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356242 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.356409 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356395 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} err="failed to get container status \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" May 20 14:10:11.356449 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356409 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.356621 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356604 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} err="failed to get container status \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" May 20 14:10:11.356679 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356621 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.356822 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356802 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} err="failed to get container status \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" May 20 14:10:11.356865 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356823 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.357006 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.356991 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} err="failed to get container status \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" May 20 14:10:11.357006 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357005 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.357170 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357152 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} err="failed to get container status \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" May 20 14:10:11.357243 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357172 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.357363 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357347 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} err="failed to get container status \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" May 20 14:10:11.357426 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357364 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.357633 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357615 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} err="failed to get container status \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" May 20 14:10:11.357707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357634 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.357831 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357814 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} err="failed to get container status \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" May 20 14:10:11.357895 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.357832 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.358054 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358036 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} err="failed to get container status \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" May 20 14:10:11.358118 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358056 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.358261 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358244 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} err="failed to get container status \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" May 20 14:10:11.358322 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358262 2555 scope.go:117] "RemoveContainer" containerID="fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2" May 20 14:10:11.358480 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358457 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2"} err="failed to get container status \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": rpc error: code = NotFound desc = could not find container \"fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2\": container with ID starting with fe6294fcc2bcc508ae8f80fc9f17be48c6138ea1597b446c41a1b5cb78fc13f2 not found: ID does not exist" May 20 14:10:11.358535 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358481 2555 scope.go:117] "RemoveContainer" containerID="f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e" May 20 14:10:11.358715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358687 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e"} err="failed to get container status \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": rpc error: code = NotFound desc = could not find container \"f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e\": container with ID starting with f9ea195e52d4f7031b5460a3ba204b0ea307ab820870cdde993d1d939cb06f6e not found: ID does not exist" May 20 14:10:11.358715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358715 2555 scope.go:117] "RemoveContainer" containerID="59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007" May 20 14:10:11.358911 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358894 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007"} err="failed to get container status \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": rpc error: code = NotFound desc = could not find container \"59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007\": container with ID starting with 59b8705cb559b3ab5487e82e21cc8d9b8579fe128a2d3552e275541c8c01b007 not found: ID does not exist" May 20 14:10:11.358911 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.358912 2555 scope.go:117] "RemoveContainer" containerID="d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2" May 20 14:10:11.359121 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359105 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2"} err="failed to get container status \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": rpc error: code = NotFound desc = could not find container \"d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2\": container with ID starting with d1e6e29791c0bd92c2b5d00e5890eabff2b5b153dcadb79b752d1be6159a7ee2 not found: ID does not exist" May 20 14:10:11.359121 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359121 2555 scope.go:117] "RemoveContainer" containerID="967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f" May 20 14:10:11.359389 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359372 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f"} err="failed to get container status \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": rpc error: code = NotFound desc = could not find container \"967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f\": container with ID starting with 967c709e3506a02c311056a2596d54a5b686baacce042815d99abe72826d8c5f not found: ID does not exist" May 20 14:10:11.359439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359390 2555 scope.go:117] "RemoveContainer" containerID="bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab" May 20 14:10:11.359603 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359587 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab"} err="failed to get container status \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": rpc error: code = NotFound desc = could not find container \"bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab\": container with ID starting with bdfdab1d0846a0c9b89d4f43eaa7662b3b9b61cb2a304d34491c851e15ef50ab not found: ID does not exist" May 20 14:10:11.359603 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359603 2555 scope.go:117] "RemoveContainer" containerID="7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984" May 20 14:10:11.359781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.359768 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984"} err="failed to get container status \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": rpc error: code = NotFound desc = could not find container \"7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984\": container with ID starting with 7de82c0b71470c3374d3dc5d54bbc3ef2495133a111da4b6904a72e3f628c984 not found: ID does not exist" May 20 14:10:11.367467 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367447 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:11.367721 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367708 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-web" May 20 14:10:11.367721 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367721 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-web" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367733 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="config-reloader" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367740 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="config-reloader" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367747 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="init-config-reloader" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367753 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="init-config-reloader" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367758 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="prometheus" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367763 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="prometheus" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367770 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="thanos-sidecar" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367774 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="thanos-sidecar" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367784 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367789 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367797 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-thanos" May 20 14:10:11.367823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367803 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-thanos" May 20 14:10:11.368138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367847 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-web" May 20 14:10:11.368138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367854 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="config-reloader" May 20 14:10:11.368138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367859 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy" May 20 14:10:11.368138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367865 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="kube-rbac-proxy-thanos" May 20 14:10:11.368138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367872 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="prometheus" May 20 14:10:11.368138 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.367877 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" containerName="thanos-sidecar" May 20 14:10:11.372407 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.372394 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.375134 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375117 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s48p6\"" May 20 14:10:11.375252 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375173 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 14:10:11.375252 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375173 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 14:10:11.375252 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375177 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 14:10:11.375452 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375258 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 14:10:11.375607 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375539 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 14:10:11.375607 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375572 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 14:10:11.375747 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375616 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 14:10:11.375903 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.375881 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-jt01unkocepv\"" May 20 14:10:11.376131 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.376115 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 14:10:11.376336 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.376321 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 14:10:11.376435 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.376328 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 14:10:11.378287 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.378266 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 14:10:11.381818 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.381803 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 14:10:11.389489 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.389470 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:11.458418 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.458325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.458418 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.458385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.458743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.458526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.458743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.458595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.458743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.458670 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459014 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.458995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459105 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459282 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-config\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459402 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhs5r\" (UniqueName: \"kubernetes.io/projected/de866c7c-05dc-487b-befe-47560ea431b9-kube-api-access-nhs5r\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459402 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459379 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459584 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459421 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459584 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459461 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459584 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459584 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de866c7c-05dc-487b-befe-47560ea431b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459787 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459614 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459787 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de866c7c-05dc-487b-befe-47560ea431b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459787 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459766 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.459931 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.459797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560773 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560741 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560773 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560775 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560805 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560834 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de866c7c-05dc-487b-befe-47560ea431b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560856 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560880 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de866c7c-05dc-487b-befe-47560ea431b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560905 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.560955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560928 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560959 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.560984 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561118 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561147 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561199 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561190 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561224 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561261 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561296 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-config\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561318 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhs5r\" (UniqueName: \"kubernetes.io/projected/de866c7c-05dc-487b-befe-47560ea431b9-kube-api-access-nhs5r\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561349 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561824 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561671 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.561824 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.562249 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.561938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.562249 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.562197 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.562801 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.562536 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.564279 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.564229 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de866c7c-05dc-487b-befe-47560ea431b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.565219 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.564826 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.565219 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.565020 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de866c7c-05dc-487b-befe-47560ea431b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.565219 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.565183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.565413 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.565396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566074 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566209 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566182 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566393 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566374 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566484 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566457 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566634 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566613 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de866c7c-05dc-487b-befe-47560ea431b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566682 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.566715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.566697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/de866c7c-05dc-487b-befe-47560ea431b9-config\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.570126 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.570107 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhs5r\" (UniqueName: \"kubernetes.io/projected/de866c7c-05dc-487b-befe-47560ea431b9-kube-api-access-nhs5r\") pod \"prometheus-k8s-0\" (UID: \"de866c7c-05dc-487b-befe-47560ea431b9\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.681792 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.681761 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:11.816657 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:11.816630 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:11.818612 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:10:11.818587 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde866c7c_05dc_487b_befe_47560ea431b9.slice/crio-bb52c30961de97ca9bb776415cfbb20711a2ae4b27d538438dbe91678211d12b WatchSource:0}: Error finding container bb52c30961de97ca9bb776415cfbb20711a2ae4b27d538438dbe91678211d12b: Status 404 returned error can't find the container with id bb52c30961de97ca9bb776415cfbb20711a2ae4b27d538438dbe91678211d12b May 20 14:10:12.308491 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:12.308456 2555 generic.go:358] "Generic (PLEG): container finished" podID="de866c7c-05dc-487b-befe-47560ea431b9" containerID="35eae555de7ba47d141fc7329965d8c16bb7089304189a358af581dd37493da8" exitCode=0 May 20 14:10:12.308947 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:12.308543 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerDied","Data":"35eae555de7ba47d141fc7329965d8c16bb7089304189a358af581dd37493da8"} May 20 14:10:12.308947 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:12.308579 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"bb52c30961de97ca9bb776415cfbb20711a2ae4b27d538438dbe91678211d12b"} May 20 14:10:12.575525 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:12.575471 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d70d30e-b444-473d-bee2-5a15906ab93b" path="/var/lib/kubelet/pods/8d70d30e-b444-473d-bee2-5a15906ab93b/volumes" May 20 14:10:13.314789 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.314755 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"7899a85c99d53950f6b39970d234a6442639bb76269b01aca84243028cb59007"} May 20 14:10:13.315125 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.314798 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"e03e78a01304d54b9154c8d1fe923ad54b21c18e3824c132e358f1f5679bd845"} May 20 14:10:13.315125 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.314814 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"4e32da54883aeb1cf2f414261bb775bc1e1e70d1d5ce0d5b9785bf92feede38f"} May 20 14:10:13.315125 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.314826 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"f3cb9c090215b430d9efd76a6035e886670914a3c164e4b1a01987c601c73005"} May 20 14:10:13.315125 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.314839 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"7b9ec0047f480d5b90ae000b612ce43b74a866051f520d889f578b3343512a64"} May 20 14:10:13.315125 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.314851 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de866c7c-05dc-487b-befe-47560ea431b9","Type":"ContainerStarted","Data":"2c784b0ee36312c6537ce6066f137d034776df3825f4830c9179e2c9e8e177a3"} May 20 14:10:13.350884 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:13.350831 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.350814671 podStartE2EDuration="2.350814671s" podCreationTimestamp="2026-05-20 14:10:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:10:13.34844048 +0000 UTC m=+215.361991676" watchObservedRunningTime="2026-05-20 14:10:13.350814671 +0000 UTC m=+215.364365867" May 20 14:10:16.682782 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:10:16.682741 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:11.682783 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:11.682697 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:11.697685 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:11.697657 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:12.500437 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:12.500411 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:38.473395 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:38.473360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:11:38.473985 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:38.473966 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:11:38.476358 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:38.476340 2555 kubelet.go:1628] "Image garbage collection succeeded" May 20 14:11:53.999659 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:53.999623 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-q97v6"] May 20 14:11:54.002594 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.002579 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.005373 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.005352 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 14:11:54.005488 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.005440 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t7cqn\"" May 20 14:11:54.006467 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.006452 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 14:11:54.011475 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.011444 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-q97v6"] May 20 14:11:54.080374 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.080344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/053a2092-6566-4e5a-850d-b006eb3207c8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-q97v6\" (UID: \"053a2092-6566-4e5a-850d-b006eb3207c8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.080634 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.080393 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5cn\" (UniqueName: \"kubernetes.io/projected/053a2092-6566-4e5a-850d-b006eb3207c8-kube-api-access-9c5cn\") pod \"cert-manager-cainjector-68b757865b-q97v6\" (UID: \"053a2092-6566-4e5a-850d-b006eb3207c8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.181867 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.181825 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/053a2092-6566-4e5a-850d-b006eb3207c8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-q97v6\" (UID: \"053a2092-6566-4e5a-850d-b006eb3207c8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.182057 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.181885 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5cn\" (UniqueName: \"kubernetes.io/projected/053a2092-6566-4e5a-850d-b006eb3207c8-kube-api-access-9c5cn\") pod \"cert-manager-cainjector-68b757865b-q97v6\" (UID: \"053a2092-6566-4e5a-850d-b006eb3207c8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.193615 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.193587 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/053a2092-6566-4e5a-850d-b006eb3207c8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-q97v6\" (UID: \"053a2092-6566-4e5a-850d-b006eb3207c8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.193736 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.193701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5cn\" (UniqueName: \"kubernetes.io/projected/053a2092-6566-4e5a-850d-b006eb3207c8-kube-api-access-9c5cn\") pod \"cert-manager-cainjector-68b757865b-q97v6\" (UID: \"053a2092-6566-4e5a-850d-b006eb3207c8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.312181 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.312087 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" May 20 14:11:54.438494 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.438465 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-q97v6"] May 20 14:11:54.442145 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:11:54.442117 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053a2092_6566_4e5a_850d_b006eb3207c8.slice/crio-462d0d844a10edd63dff7abed4de877e9fc3548f35d8db99b6238701e6b5e544 WatchSource:0}: Error finding container 462d0d844a10edd63dff7abed4de877e9fc3548f35d8db99b6238701e6b5e544: Status 404 returned error can't find the container with id 462d0d844a10edd63dff7abed4de877e9fc3548f35d8db99b6238701e6b5e544 May 20 14:11:54.443965 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.443949 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:11:54.598789 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:54.598718 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" event={"ID":"053a2092-6566-4e5a-850d-b006eb3207c8","Type":"ContainerStarted","Data":"462d0d844a10edd63dff7abed4de877e9fc3548f35d8db99b6238701e6b5e544"} May 20 14:11:59.614078 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:59.614045 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" event={"ID":"053a2092-6566-4e5a-850d-b006eb3207c8","Type":"ContainerStarted","Data":"346d78d4c030f25263c1fe2ad4f3b947c0cd499c0aeed35886df93927609498d"} May 20 14:11:59.635033 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:11:59.634988 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-q97v6" podStartSLOduration=2.447510117 podStartE2EDuration="6.634976327s" podCreationTimestamp="2026-05-20 14:11:53 +0000 UTC" firstStartedPulling="2026-05-20 14:11:54.444075719 +0000 UTC m=+316.457626891" lastFinishedPulling="2026-05-20 14:11:58.631541916 +0000 UTC m=+320.645093101" observedRunningTime="2026-05-20 14:11:59.634228338 +0000 UTC m=+321.647779533" watchObservedRunningTime="2026-05-20 14:11:59.634976327 +0000 UTC m=+321.648527522" May 20 14:12:31.805576 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.805492 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc"] May 20 14:12:31.811701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.811676 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:31.814117 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.814091 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 14:12:31.814277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.814148 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 14:12:31.814277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.814155 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 14:12:31.814360 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.814331 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 14:12:31.814772 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.814751 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4qpm2\"" May 20 14:12:31.828969 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.828948 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc"] May 20 14:12:31.987333 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.987297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:31.987542 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.987352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:31.987542 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:31.987388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24x2\" (UniqueName: \"kubernetes.io/projected/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-kube-api-access-f24x2\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.088720 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.088631 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.088720 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.088680 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.088720 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.088699 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f24x2\" (UniqueName: \"kubernetes.io/projected/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-kube-api-access-f24x2\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.091079 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.091056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.091182 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.091094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.105904 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.105873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24x2\" (UniqueName: \"kubernetes.io/projected/fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de-kube-api-access-f24x2\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-vfrfc\" (UID: \"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.121162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.121131 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:32.259569 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.259525 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc"] May 20 14:12:32.261762 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:12:32.261738 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4d06ee_4e2a_453c_adb8_6c86b5b9b5de.slice/crio-bebfdc090b9a574a26c317ea52b0f96259bc8a414baec7f06737884324938795 WatchSource:0}: Error finding container bebfdc090b9a574a26c317ea52b0f96259bc8a414baec7f06737884324938795: Status 404 returned error can't find the container with id bebfdc090b9a574a26c317ea52b0f96259bc8a414baec7f06737884324938795 May 20 14:12:32.704096 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:32.704043 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" event={"ID":"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de","Type":"ContainerStarted","Data":"bebfdc090b9a574a26c317ea52b0f96259bc8a414baec7f06737884324938795"} May 20 14:12:34.711156 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:34.711122 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" event={"ID":"fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de","Type":"ContainerStarted","Data":"44c8faf0e54552054cbf1552bcbc4d9f79ae07f9d13bdce6c9f676a305a29c63"} May 20 14:12:34.711612 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:34.711242 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:34.749064 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:34.749003 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" podStartSLOduration=1.4736059369999999 podStartE2EDuration="3.748983244s" podCreationTimestamp="2026-05-20 14:12:31 +0000 UTC" firstStartedPulling="2026-05-20 14:12:32.263378633 +0000 UTC m=+354.276929807" lastFinishedPulling="2026-05-20 14:12:34.538755935 +0000 UTC m=+356.552307114" observedRunningTime="2026-05-20 14:12:34.743153942 +0000 UTC m=+356.756705150" watchObservedRunningTime="2026-05-20 14:12:34.748983244 +0000 UTC m=+356.762534440" May 20 14:12:36.842982 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.842951 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49"] May 20 14:12:36.845575 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.845559 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:36.848637 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.848618 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 20 14:12:36.849795 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.849779 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 20 14:12:36.850163 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.850148 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 20 14:12:36.850414 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.850392 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gts7f\"" May 20 14:12:36.851055 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.851026 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 20 14:12:36.851146 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.851058 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 20 14:12:36.862491 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.862468 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49"] May 20 14:12:36.934408 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.934377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae91833c-1fd7-465b-9cac-5101c2442226-manager-config\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:36.934626 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.934418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcbc9\" (UniqueName: \"kubernetes.io/projected/ae91833c-1fd7-465b-9cac-5101c2442226-kube-api-access-qcbc9\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:36.934626 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.934444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae91833c-1fd7-465b-9cac-5101c2442226-metrics-cert\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:36.934626 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:36.934553 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae91833c-1fd7-465b-9cac-5101c2442226-cert\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.035516 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.035473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae91833c-1fd7-465b-9cac-5101c2442226-manager-config\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.035626 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.035570 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcbc9\" (UniqueName: \"kubernetes.io/projected/ae91833c-1fd7-465b-9cac-5101c2442226-kube-api-access-qcbc9\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.035626 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.035610 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae91833c-1fd7-465b-9cac-5101c2442226-metrics-cert\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.035733 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.035642 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae91833c-1fd7-465b-9cac-5101c2442226-cert\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.036273 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.036252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae91833c-1fd7-465b-9cac-5101c2442226-manager-config\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.037998 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.037976 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae91833c-1fd7-465b-9cac-5101c2442226-cert\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.038096 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.038079 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae91833c-1fd7-465b-9cac-5101c2442226-metrics-cert\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.054238 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.054203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcbc9\" (UniqueName: \"kubernetes.io/projected/ae91833c-1fd7-465b-9cac-5101c2442226-kube-api-access-qcbc9\") pod \"lws-controller-manager-6c6588f5c6-hzg49\" (UID: \"ae91833c-1fd7-465b-9cac-5101c2442226\") " pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.155039 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.154932 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:37.316865 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.316833 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49"] May 20 14:12:37.321141 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:12:37.321111 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae91833c_1fd7_465b_9cac_5101c2442226.slice/crio-fe7deeb511c1f0f175868f9638dce01b3dd93da4b1062174c60ad99a74c48985 WatchSource:0}: Error finding container fe7deeb511c1f0f175868f9638dce01b3dd93da4b1062174c60ad99a74c48985: Status 404 returned error can't find the container with id fe7deeb511c1f0f175868f9638dce01b3dd93da4b1062174c60ad99a74c48985 May 20 14:12:37.731910 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:37.731878 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" event={"ID":"ae91833c-1fd7-465b-9cac-5101c2442226","Type":"ContainerStarted","Data":"fe7deeb511c1f0f175868f9638dce01b3dd93da4b1062174c60ad99a74c48985"} May 20 14:12:40.742777 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:40.742746 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" event={"ID":"ae91833c-1fd7-465b-9cac-5101c2442226","Type":"ContainerStarted","Data":"2e5f8f1186fddde91a60f228fa60c45c288ce2ab113eca5b09c1c84605c3098b"} May 20 14:12:40.743198 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:40.742857 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:40.783610 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:40.783555 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" podStartSLOduration=1.781170138 podStartE2EDuration="4.783539606s" podCreationTimestamp="2026-05-20 14:12:36 +0000 UTC" firstStartedPulling="2026-05-20 14:12:37.322960846 +0000 UTC m=+359.336512019" lastFinishedPulling="2026-05-20 14:12:40.325330295 +0000 UTC m=+362.338881487" observedRunningTime="2026-05-20 14:12:40.782778531 +0000 UTC m=+362.796329726" watchObservedRunningTime="2026-05-20 14:12:40.783539606 +0000 UTC m=+362.797090800" May 20 14:12:45.716982 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:45.716952 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-vfrfc" May 20 14:12:50.969382 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.969349 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-587b5db545-6bzc2"] May 20 14:12:50.971395 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.971379 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:50.973884 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.973858 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 20 14:12:50.974187 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.974167 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 14:12:50.974978 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.974956 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 14:12:50.975144 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.975084 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4pjz5\"" May 20 14:12:50.975215 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.975155 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 14:12:50.986872 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:50.986843 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-587b5db545-6bzc2"] May 20 14:12:51.046254 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.046219 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2h4\" (UniqueName: \"kubernetes.io/projected/33a0f625-0afc-4c2a-968b-9781a7c58b6d-kube-api-access-mg2h4\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.046254 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.046259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a0f625-0afc-4c2a-968b-9781a7c58b6d-tls-certs\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.046448 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.046296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33a0f625-0afc-4c2a-968b-9781a7c58b6d-tmp\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.146851 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.146812 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33a0f625-0afc-4c2a-968b-9781a7c58b6d-tmp\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.147018 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.146893 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2h4\" (UniqueName: \"kubernetes.io/projected/33a0f625-0afc-4c2a-968b-9781a7c58b6d-kube-api-access-mg2h4\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.147018 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.146930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a0f625-0afc-4c2a-968b-9781a7c58b6d-tls-certs\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.149325 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.149292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33a0f625-0afc-4c2a-968b-9781a7c58b6d-tmp\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.149494 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.149477 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a0f625-0afc-4c2a-968b-9781a7c58b6d-tls-certs\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.155767 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.155744 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2h4\" (UniqueName: \"kubernetes.io/projected/33a0f625-0afc-4c2a-968b-9781a7c58b6d-kube-api-access-mg2h4\") pod \"kube-auth-proxy-587b5db545-6bzc2\" (UID: \"33a0f625-0afc-4c2a-968b-9781a7c58b6d\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.282167 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.282077 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" May 20 14:12:51.427153 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.427125 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-587b5db545-6bzc2"] May 20 14:12:51.430825 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:12:51.430791 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a0f625_0afc_4c2a_968b_9781a7c58b6d.slice/crio-99781445eaba9b23016b7dc8c2c7b5c1113fe0735c3e558573831154e90b10a2 WatchSource:0}: Error finding container 99781445eaba9b23016b7dc8c2c7b5c1113fe0735c3e558573831154e90b10a2: Status 404 returned error can't find the container with id 99781445eaba9b23016b7dc8c2c7b5c1113fe0735c3e558573831154e90b10a2 May 20 14:12:51.748638 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.748612 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c6588f5c6-hzg49" May 20 14:12:51.777565 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:51.777533 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" event={"ID":"33a0f625-0afc-4c2a-968b-9781a7c58b6d","Type":"ContainerStarted","Data":"99781445eaba9b23016b7dc8c2c7b5c1113fe0735c3e558573831154e90b10a2"} May 20 14:12:54.793037 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:54.793003 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" event={"ID":"33a0f625-0afc-4c2a-968b-9781a7c58b6d","Type":"ContainerStarted","Data":"efb88e0a86b46c07021688b6df19db3006a5fe018f25f189accaf9cccfe25157"} May 20 14:12:54.813700 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:12:54.813651 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-587b5db545-6bzc2" podStartSLOduration=1.620179533 podStartE2EDuration="4.813635892s" podCreationTimestamp="2026-05-20 14:12:50 +0000 UTC" firstStartedPulling="2026-05-20 14:12:51.432394636 +0000 UTC m=+373.445945812" lastFinishedPulling="2026-05-20 14:12:54.625850995 +0000 UTC m=+376.639402171" observedRunningTime="2026-05-20 14:12:54.812126187 +0000 UTC m=+376.825677384" watchObservedRunningTime="2026-05-20 14:12:54.813635892 +0000 UTC m=+376.827187087" May 20 14:15:45.231432 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.231395 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:15:45.234691 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.234676 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.237227 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.237209 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4g4gh\"" May 20 14:15:45.237323 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.237214 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 14:15:45.238217 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.238200 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 14:15:45.238282 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.238205 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 20 14:15:45.243869 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.243839 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:15:45.267842 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.267822 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:15:45.302545 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.302523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d57d20c-4110-4a9c-8632-9729d7b5f0da-config-file\") pod \"limitador-limitador-78c99df468-p49b2\" (UID: \"4d57d20c-4110-4a9c-8632-9729d7b5f0da\") " pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.302669 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.302559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt586\" (UniqueName: \"kubernetes.io/projected/4d57d20c-4110-4a9c-8632-9729d7b5f0da-kube-api-access-pt586\") pod \"limitador-limitador-78c99df468-p49b2\" (UID: \"4d57d20c-4110-4a9c-8632-9729d7b5f0da\") " pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.403579 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.403548 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d57d20c-4110-4a9c-8632-9729d7b5f0da-config-file\") pod \"limitador-limitador-78c99df468-p49b2\" (UID: \"4d57d20c-4110-4a9c-8632-9729d7b5f0da\") " pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.403700 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.403591 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt586\" (UniqueName: \"kubernetes.io/projected/4d57d20c-4110-4a9c-8632-9729d7b5f0da-kube-api-access-pt586\") pod \"limitador-limitador-78c99df468-p49b2\" (UID: \"4d57d20c-4110-4a9c-8632-9729d7b5f0da\") " pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.404184 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.404167 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d57d20c-4110-4a9c-8632-9729d7b5f0da-config-file\") pod \"limitador-limitador-78c99df468-p49b2\" (UID: \"4d57d20c-4110-4a9c-8632-9729d7b5f0da\") " pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.414484 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.414457 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt586\" (UniqueName: \"kubernetes.io/projected/4d57d20c-4110-4a9c-8632-9729d7b5f0da-kube-api-access-pt586\") pod \"limitador-limitador-78c99df468-p49b2\" (UID: \"4d57d20c-4110-4a9c-8632-9729d7b5f0da\") " pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.544792 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.544732 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:45.667845 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.667816 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:15:45.671213 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:15:45.671189 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d57d20c_4110_4a9c_8632_9729d7b5f0da.slice/crio-1842023cf809e1f2fcf1585e617db37fd1cfc3894c6b9c30bbb8f1bda8893acb WatchSource:0}: Error finding container 1842023cf809e1f2fcf1585e617db37fd1cfc3894c6b9c30bbb8f1bda8893acb: Status 404 returned error can't find the container with id 1842023cf809e1f2fcf1585e617db37fd1cfc3894c6b9c30bbb8f1bda8893acb May 20 14:15:45.680393 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.680370 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vhb7s"] May 20 14:15:45.684772 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.684756 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:45.687693 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.687675 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q5nkt\"" May 20 14:15:45.700926 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.700898 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vhb7s"] May 20 14:15:45.807232 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.807147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhxtr\" (UniqueName: \"kubernetes.io/projected/2f133a99-be46-4257-a1fd-65eec57144a9-kube-api-access-xhxtr\") pod \"authorino-f99f4b5cd-vhb7s\" (UID: \"2f133a99-be46-4257-a1fd-65eec57144a9\") " pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:45.907701 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.907670 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhxtr\" (UniqueName: \"kubernetes.io/projected/2f133a99-be46-4257-a1fd-65eec57144a9-kube-api-access-xhxtr\") pod \"authorino-f99f4b5cd-vhb7s\" (UID: \"2f133a99-be46-4257-a1fd-65eec57144a9\") " pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:45.918698 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.918670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhxtr\" (UniqueName: \"kubernetes.io/projected/2f133a99-be46-4257-a1fd-65eec57144a9-kube-api-access-xhxtr\") pod \"authorino-f99f4b5cd-vhb7s\" (UID: \"2f133a99-be46-4257-a1fd-65eec57144a9\") " pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:45.994309 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:45.994288 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:46.130920 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:46.130894 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vhb7s"] May 20 14:15:46.133374 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:15:46.133345 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f133a99_be46_4257_a1fd_65eec57144a9.slice/crio-042641fa5fdbfddc55f3abda5754a2801e84f938a49f60eb1cd65c270551ba75 WatchSource:0}: Error finding container 042641fa5fdbfddc55f3abda5754a2801e84f938a49f60eb1cd65c270551ba75: Status 404 returned error can't find the container with id 042641fa5fdbfddc55f3abda5754a2801e84f938a49f60eb1cd65c270551ba75 May 20 14:15:46.335406 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:46.335317 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" event={"ID":"2f133a99-be46-4257-a1fd-65eec57144a9","Type":"ContainerStarted","Data":"042641fa5fdbfddc55f3abda5754a2801e84f938a49f60eb1cd65c270551ba75"} May 20 14:15:46.337103 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:46.337049 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" event={"ID":"4d57d20c-4110-4a9c-8632-9729d7b5f0da","Type":"ContainerStarted","Data":"1842023cf809e1f2fcf1585e617db37fd1cfc3894c6b9c30bbb8f1bda8893acb"} May 20 14:15:50.180798 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:50.180769 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vhb7s"] May 20 14:15:50.351659 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:50.351563 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" event={"ID":"2f133a99-be46-4257-a1fd-65eec57144a9","Type":"ContainerStarted","Data":"e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa"} May 20 14:15:50.352800 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:50.352777 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" event={"ID":"4d57d20c-4110-4a9c-8632-9729d7b5f0da","Type":"ContainerStarted","Data":"192ef3b5e10e9a1f4d1ebb90a30be558b44807db20656c73ae1e16e144a1803b"} May 20 14:15:50.352927 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:50.352908 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:15:50.370171 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:50.370125 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" podStartSLOduration=1.479120739 podStartE2EDuration="5.370113855s" podCreationTimestamp="2026-05-20 14:15:45 +0000 UTC" firstStartedPulling="2026-05-20 14:15:46.135199076 +0000 UTC m=+548.148750256" lastFinishedPulling="2026-05-20 14:15:50.0261922 +0000 UTC m=+552.039743372" observedRunningTime="2026-05-20 14:15:50.368681513 +0000 UTC m=+552.382232710" watchObservedRunningTime="2026-05-20 14:15:50.370113855 +0000 UTC m=+552.383665049" May 20 14:15:50.387154 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:50.387116 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" podStartSLOduration=1.090251311 podStartE2EDuration="5.387105234s" podCreationTimestamp="2026-05-20 14:15:45 +0000 UTC" firstStartedPulling="2026-05-20 14:15:45.673091972 +0000 UTC m=+547.686643159" lastFinishedPulling="2026-05-20 14:15:49.96994591 +0000 UTC m=+551.983497082" observedRunningTime="2026-05-20 14:15:50.386424343 +0000 UTC m=+552.399975548" watchObservedRunningTime="2026-05-20 14:15:50.387105234 +0000 UTC m=+552.400656449" May 20 14:15:51.355750 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:51.355711 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" podUID="2f133a99-be46-4257-a1fd-65eec57144a9" containerName="authorino" containerID="cri-o://e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa" gracePeriod=30 May 20 14:15:51.593217 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:51.593195 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:51.662162 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:51.662094 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhxtr\" (UniqueName: \"kubernetes.io/projected/2f133a99-be46-4257-a1fd-65eec57144a9-kube-api-access-xhxtr\") pod \"2f133a99-be46-4257-a1fd-65eec57144a9\" (UID: \"2f133a99-be46-4257-a1fd-65eec57144a9\") " May 20 14:15:51.664461 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:51.664435 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f133a99-be46-4257-a1fd-65eec57144a9-kube-api-access-xhxtr" (OuterVolumeSpecName: "kube-api-access-xhxtr") pod "2f133a99-be46-4257-a1fd-65eec57144a9" (UID: "2f133a99-be46-4257-a1fd-65eec57144a9"). InnerVolumeSpecName "kube-api-access-xhxtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:15:51.763881 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:51.763853 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhxtr\" (UniqueName: \"kubernetes.io/projected/2f133a99-be46-4257-a1fd-65eec57144a9-kube-api-access-xhxtr\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:15:52.359305 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.359274 2555 generic.go:358] "Generic (PLEG): container finished" podID="2f133a99-be46-4257-a1fd-65eec57144a9" containerID="e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa" exitCode=0 May 20 14:15:52.359743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.359319 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" event={"ID":"2f133a99-be46-4257-a1fd-65eec57144a9","Type":"ContainerDied","Data":"e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa"} May 20 14:15:52.359743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.359322 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" May 20 14:15:52.359743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.359339 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vhb7s" event={"ID":"2f133a99-be46-4257-a1fd-65eec57144a9","Type":"ContainerDied","Data":"042641fa5fdbfddc55f3abda5754a2801e84f938a49f60eb1cd65c270551ba75"} May 20 14:15:52.359743 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.359359 2555 scope.go:117] "RemoveContainer" containerID="e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa" May 20 14:15:52.373145 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.373125 2555 scope.go:117] "RemoveContainer" containerID="e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa" May 20 14:15:52.373395 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:15:52.373378 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa\": container with ID starting with e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa not found: ID does not exist" containerID="e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa" May 20 14:15:52.373441 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.373403 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa"} err="failed to get container status \"e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa\": rpc error: code = NotFound desc = could not find container \"e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa\": container with ID starting with e1abba96e1deba7d14eb12dff64be787f144cefdb297348800cc33e7625a9bfa not found: ID does not exist" May 20 14:15:52.384213 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.384189 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vhb7s"] May 20 14:15:52.388239 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.388218 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vhb7s"] May 20 14:15:52.573159 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:15:52.573123 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f133a99-be46-4257-a1fd-65eec57144a9" path="/var/lib/kubelet/pods/2f133a99-be46-4257-a1fd-65eec57144a9/volumes" May 20 14:16:01.356914 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:01.356885 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-p49b2" May 20 14:16:18.368202 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.368165 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-k2d8d"] May 20 14:16:18.368640 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.368499 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f133a99-be46-4257-a1fd-65eec57144a9" containerName="authorino" May 20 14:16:18.368640 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.368526 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f133a99-be46-4257-a1fd-65eec57144a9" containerName="authorino" May 20 14:16:18.368640 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.368584 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f133a99-be46-4257-a1fd-65eec57144a9" containerName="authorino" May 20 14:16:18.371699 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.371683 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:18.374599 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.374578 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q5nkt\"" May 20 14:16:18.382650 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.382627 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-k2d8d"] May 20 14:16:18.480277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.480242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sclc2\" (UniqueName: \"kubernetes.io/projected/f3edaea0-94ad-4cf7-98c3-0d158c5ca651-kube-api-access-sclc2\") pod \"authorino-8b475cf9f-k2d8d\" (UID: \"f3edaea0-94ad-4cf7-98c3-0d158c5ca651\") " pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:18.559421 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.559385 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-k2d8d"] May 20 14:16:18.559677 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:16:18.559656 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sclc2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-k2d8d" podUID="f3edaea0-94ad-4cf7-98c3-0d158c5ca651" May 20 14:16:18.581094 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.581065 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sclc2\" (UniqueName: \"kubernetes.io/projected/f3edaea0-94ad-4cf7-98c3-0d158c5ca651-kube-api-access-sclc2\") pod \"authorino-8b475cf9f-k2d8d\" (UID: \"f3edaea0-94ad-4cf7-98c3-0d158c5ca651\") " pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:18.595246 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.595217 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sclc2\" (UniqueName: \"kubernetes.io/projected/f3edaea0-94ad-4cf7-98c3-0d158c5ca651-kube-api-access-sclc2\") pod \"authorino-8b475cf9f-k2d8d\" (UID: \"f3edaea0-94ad-4cf7-98c3-0d158c5ca651\") " pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:18.695038 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.694960 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-946f7964-hnbfj"] May 20 14:16:18.698229 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.698212 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:18.702192 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.702171 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 20 14:16:18.711339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.711313 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-946f7964-hnbfj"] May 20 14:16:18.783095 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.783061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e67664dc-7e4f-4c13-9ffc-6a078c477c67-tls-cert\") pod \"authorino-946f7964-hnbfj\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:18.783256 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.783106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xns\" (UniqueName: \"kubernetes.io/projected/e67664dc-7e4f-4c13-9ffc-6a078c477c67-kube-api-access-b8xns\") pod \"authorino-946f7964-hnbfj\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:18.884267 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.884234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e67664dc-7e4f-4c13-9ffc-6a078c477c67-tls-cert\") pod \"authorino-946f7964-hnbfj\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:18.884436 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.884283 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xns\" (UniqueName: \"kubernetes.io/projected/e67664dc-7e4f-4c13-9ffc-6a078c477c67-kube-api-access-b8xns\") pod \"authorino-946f7964-hnbfj\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:18.886735 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.886710 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e67664dc-7e4f-4c13-9ffc-6a078c477c67-tls-cert\") pod \"authorino-946f7964-hnbfj\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:18.892973 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:18.892950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xns\" (UniqueName: \"kubernetes.io/projected/e67664dc-7e4f-4c13-9ffc-6a078c477c67-kube-api-access-b8xns\") pod \"authorino-946f7964-hnbfj\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:19.010007 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.009976 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:16:19.133012 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.132991 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-946f7964-hnbfj"] May 20 14:16:19.135448 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:16:19.135422 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode67664dc_7e4f_4c13_9ffc_6a078c477c67.slice/crio-b27f14b990029f1f6da69e56682163146eab73b4080d18deb728fb9a7d6286e2 WatchSource:0}: Error finding container b27f14b990029f1f6da69e56682163146eab73b4080d18deb728fb9a7d6286e2: Status 404 returned error can't find the container with id b27f14b990029f1f6da69e56682163146eab73b4080d18deb728fb9a7d6286e2 May 20 14:16:19.452135 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.452040 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-946f7964-hnbfj" event={"ID":"e67664dc-7e4f-4c13-9ffc-6a078c477c67","Type":"ContainerStarted","Data":"b27f14b990029f1f6da69e56682163146eab73b4080d18deb728fb9a7d6286e2"} May 20 14:16:19.452135 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.452095 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:19.456855 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.456832 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:19.489439 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.489410 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sclc2\" (UniqueName: \"kubernetes.io/projected/f3edaea0-94ad-4cf7-98c3-0d158c5ca651-kube-api-access-sclc2\") pod \"f3edaea0-94ad-4cf7-98c3-0d158c5ca651\" (UID: \"f3edaea0-94ad-4cf7-98c3-0d158c5ca651\") " May 20 14:16:19.491360 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.491340 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3edaea0-94ad-4cf7-98c3-0d158c5ca651-kube-api-access-sclc2" (OuterVolumeSpecName: "kube-api-access-sclc2") pod "f3edaea0-94ad-4cf7-98c3-0d158c5ca651" (UID: "f3edaea0-94ad-4cf7-98c3-0d158c5ca651"). InnerVolumeSpecName "kube-api-access-sclc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:16:19.590179 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:19.590151 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sclc2\" (UniqueName: \"kubernetes.io/projected/f3edaea0-94ad-4cf7-98c3-0d158c5ca651-kube-api-access-sclc2\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:16:20.456757 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:20.456721 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-946f7964-hnbfj" event={"ID":"e67664dc-7e4f-4c13-9ffc-6a078c477c67","Type":"ContainerStarted","Data":"a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48"} May 20 14:16:20.457124 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:20.456856 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-k2d8d" May 20 14:16:20.481719 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:20.481671 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-946f7964-hnbfj" podStartSLOduration=2.05062139 podStartE2EDuration="2.48165879s" podCreationTimestamp="2026-05-20 14:16:18 +0000 UTC" firstStartedPulling="2026-05-20 14:16:19.136653983 +0000 UTC m=+581.150205158" lastFinishedPulling="2026-05-20 14:16:19.567691379 +0000 UTC m=+581.581242558" observedRunningTime="2026-05-20 14:16:20.479816541 +0000 UTC m=+582.493367736" watchObservedRunningTime="2026-05-20 14:16:20.48165879 +0000 UTC m=+582.495209982" May 20 14:16:20.515277 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:20.515244 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-k2d8d"] May 20 14:16:20.518860 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:20.518837 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-k2d8d"] May 20 14:16:20.572275 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:20.572245 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3edaea0-94ad-4cf7-98c3-0d158c5ca651" path="/var/lib/kubelet/pods/f3edaea0-94ad-4cf7-98c3-0d158c5ca651/volumes" May 20 14:16:38.502119 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:38.502093 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:16:38.502119 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:16:38.502114 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:17:00.642554 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:17:00.642523 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:17:39.976265 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:17:39.976229 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:17:53.455529 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:17:53.455473 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:18:03.901132 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.901095 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2"] May 20 14:18:03.906443 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.906425 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:03.911044 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.911015 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 20 14:18:03.911173 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.911072 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-77www\"" May 20 14:18:03.911173 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.911072 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 20 14:18:03.911173 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.911126 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 20 14:18:03.915782 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.915759 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2"] May 20 14:18:03.970609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.970575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:03.970781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.970613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:03.970781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.970650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:03.970781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.970674 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:03.970781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.970702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf98b729-011f-4111-bcb2-15d0e5232f2b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:03.970781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:03.970773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxtn\" (UniqueName: \"kubernetes.io/projected/cf98b729-011f-4111-bcb2-15d0e5232f2b-kube-api-access-2wxtn\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072018 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.071984 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf98b729-011f-4111-bcb2-15d0e5232f2b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072046 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxtn\" (UniqueName: \"kubernetes.io/projected/cf98b729-011f-4111-bcb2-15d0e5232f2b-kube-api-access-2wxtn\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072085 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072103 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072125 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072200 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072147 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072626 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072722 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.072722 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.072674 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.074494 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.074470 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf98b729-011f-4111-bcb2-15d0e5232f2b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.074729 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.074711 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf98b729-011f-4111-bcb2-15d0e5232f2b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.083980 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.083959 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxtn\" (UniqueName: \"kubernetes.io/projected/cf98b729-011f-4111-bcb2-15d0e5232f2b-kube-api-access-2wxtn\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2\" (UID: \"cf98b729-011f-4111-bcb2-15d0e5232f2b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.217314 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.217284 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:04.346954 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.346921 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2"] May 20 14:18:04.350715 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:18:04.350681 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf98b729_011f_4111_bcb2_15d0e5232f2b.slice/crio-5819ec91a207351a3d32af6550efc3494dba95b54f609b66684de022c999b5ff WatchSource:0}: Error finding container 5819ec91a207351a3d32af6550efc3494dba95b54f609b66684de022c999b5ff: Status 404 returned error can't find the container with id 5819ec91a207351a3d32af6550efc3494dba95b54f609b66684de022c999b5ff May 20 14:18:04.352414 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.352394 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:18:04.648491 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.648401 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:18:04.792874 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:04.792841 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" event={"ID":"cf98b729-011f-4111-bcb2-15d0e5232f2b","Type":"ContainerStarted","Data":"5819ec91a207351a3d32af6550efc3494dba95b54f609b66684de022c999b5ff"} May 20 14:18:07.878123 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:07.878083 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:18:11.820335 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:11.820298 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" event={"ID":"cf98b729-011f-4111-bcb2-15d0e5232f2b","Type":"ContainerStarted","Data":"959b1c82a8854905186f8c371535b842f5b7f9d4fac3c58acb13c1a581816830"} May 20 14:18:15.295804 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.295767 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2"] May 20 14:18:15.312484 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.312456 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2"] May 20 14:18:15.312652 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.312612 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.315573 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.315549 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 20 14:18:15.383097 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.383065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.383097 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.383105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.383288 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.383121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.383288 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.383149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44170805-06c2-4269-9852-5c5abcb14201-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.383288 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.383263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbk7\" (UniqueName: \"kubernetes.io/projected/44170805-06c2-4269-9852-5c5abcb14201-kube-api-access-wvbk7\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.383387 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.383301 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484514 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484456 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484514 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484515 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484748 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484538 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484748 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484560 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44170805-06c2-4269-9852-5c5abcb14201-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484748 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484720 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbk7\" (UniqueName: \"kubernetes.io/projected/44170805-06c2-4269-9852-5c5abcb14201-kube-api-access-wvbk7\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484915 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484782 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.484915 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484902 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.485033 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.484970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.485117 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.485098 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.486835 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.486813 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44170805-06c2-4269-9852-5c5abcb14201-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.487091 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.487075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44170805-06c2-4269-9852-5c5abcb14201-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.494586 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.494565 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbk7\" (UniqueName: \"kubernetes.io/projected/44170805-06c2-4269-9852-5c5abcb14201-kube-api-access-wvbk7\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2\" (UID: \"44170805-06c2-4269-9852-5c5abcb14201\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.624271 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.624193 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:15.754969 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.754947 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2"] May 20 14:18:15.757627 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:18:15.757595 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44170805_06c2_4269_9852_5c5abcb14201.slice/crio-d7873374ab5cadd3bc7959ab1cb98efa565d94a077b6c76eb6dcf76140a6e6fa WatchSource:0}: Error finding container d7873374ab5cadd3bc7959ab1cb98efa565d94a077b6c76eb6dcf76140a6e6fa: Status 404 returned error can't find the container with id d7873374ab5cadd3bc7959ab1cb98efa565d94a077b6c76eb6dcf76140a6e6fa May 20 14:18:15.834627 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.834598 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" event={"ID":"44170805-06c2-4269-9852-5c5abcb14201","Type":"ContainerStarted","Data":"ef70447c8d07bb4cceaf7a78403114fc8832e5e8fc76aff24dcb3d74fa72363b"} May 20 14:18:15.834754 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:15.834636 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" event={"ID":"44170805-06c2-4269-9852-5c5abcb14201","Type":"ContainerStarted","Data":"d7873374ab5cadd3bc7959ab1cb98efa565d94a077b6c76eb6dcf76140a6e6fa"} May 20 14:18:16.556754 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:16.556723 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:18:16.840080 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:16.839995 2555 generic.go:358] "Generic (PLEG): container finished" podID="cf98b729-011f-4111-bcb2-15d0e5232f2b" containerID="959b1c82a8854905186f8c371535b842f5b7f9d4fac3c58acb13c1a581816830" exitCode=0 May 20 14:18:16.840203 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:16.840075 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" event={"ID":"cf98b729-011f-4111-bcb2-15d0e5232f2b","Type":"ContainerDied","Data":"959b1c82a8854905186f8c371535b842f5b7f9d4fac3c58acb13c1a581816830"} May 20 14:18:18.847955 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:18.847919 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" event={"ID":"cf98b729-011f-4111-bcb2-15d0e5232f2b","Type":"ContainerStarted","Data":"b377413ef6bd2a3d3615193b3f62d3c79b493344ca3dadc05374558713233fcc"} May 20 14:18:18.848445 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:18.848125 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:18.872619 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:18.872566 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" podStartSLOduration=2.130901505 podStartE2EDuration="15.87255378s" podCreationTimestamp="2026-05-20 14:18:03 +0000 UTC" firstStartedPulling="2026-05-20 14:18:04.352548948 +0000 UTC m=+686.366100122" lastFinishedPulling="2026-05-20 14:18:18.094201223 +0000 UTC m=+700.107752397" observedRunningTime="2026-05-20 14:18:18.869998146 +0000 UTC m=+700.883549340" watchObservedRunningTime="2026-05-20 14:18:18.87255378 +0000 UTC m=+700.886105085" May 20 14:18:21.859921 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:21.859887 2555 generic.go:358] "Generic (PLEG): container finished" podID="44170805-06c2-4269-9852-5c5abcb14201" containerID="ef70447c8d07bb4cceaf7a78403114fc8832e5e8fc76aff24dcb3d74fa72363b" exitCode=0 May 20 14:18:21.860275 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:21.859961 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" event={"ID":"44170805-06c2-4269-9852-5c5abcb14201","Type":"ContainerDied","Data":"ef70447c8d07bb4cceaf7a78403114fc8832e5e8fc76aff24dcb3d74fa72363b"} May 20 14:18:22.865714 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:22.865685 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" event={"ID":"44170805-06c2-4269-9852-5c5abcb14201","Type":"ContainerStarted","Data":"8c37046182fb66dc80530dfacf2f65e65226793f07dbee31b1a3213045d1e978"} May 20 14:18:22.866088 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:22.865897 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:22.890495 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:22.890448 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" podStartSLOduration=7.47046902 podStartE2EDuration="7.890436423s" podCreationTimestamp="2026-05-20 14:18:15 +0000 UTC" firstStartedPulling="2026-05-20 14:18:21.860600581 +0000 UTC m=+703.874151754" lastFinishedPulling="2026-05-20 14:18:22.280567966 +0000 UTC m=+704.294119157" observedRunningTime="2026-05-20 14:18:22.888948252 +0000 UTC m=+704.902499446" watchObservedRunningTime="2026-05-20 14:18:22.890436423 +0000 UTC m=+704.903987618" May 20 14:18:29.864676 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:29.864640 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2" May 20 14:18:32.361596 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:32.361560 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:18:33.881330 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:33.881288 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2" May 20 14:18:34.819031 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:34.818987 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-946f7964-hnbfj"] May 20 14:18:34.819296 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:34.819270 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-946f7964-hnbfj" podUID="e67664dc-7e4f-4c13-9ffc-6a078c477c67" containerName="authorino" containerID="cri-o://a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48" gracePeriod=30 May 20 14:18:35.064248 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.064223 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:18:35.068742 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.068719 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e67664dc-7e4f-4c13-9ffc-6a078c477c67-tls-cert\") pod \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " May 20 14:18:35.068836 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.068763 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8xns\" (UniqueName: \"kubernetes.io/projected/e67664dc-7e4f-4c13-9ffc-6a078c477c67-kube-api-access-b8xns\") pod \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\" (UID: \"e67664dc-7e4f-4c13-9ffc-6a078c477c67\") " May 20 14:18:35.070835 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.070774 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67664dc-7e4f-4c13-9ffc-6a078c477c67-kube-api-access-b8xns" (OuterVolumeSpecName: "kube-api-access-b8xns") pod "e67664dc-7e4f-4c13-9ffc-6a078c477c67" (UID: "e67664dc-7e4f-4c13-9ffc-6a078c477c67"). InnerVolumeSpecName "kube-api-access-b8xns". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:18:35.078533 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.078494 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67664dc-7e4f-4c13-9ffc-6a078c477c67-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e67664dc-7e4f-4c13-9ffc-6a078c477c67" (UID: "e67664dc-7e4f-4c13-9ffc-6a078c477c67"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:18:35.169806 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.169759 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e67664dc-7e4f-4c13-9ffc-6a078c477c67-tls-cert\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:18:35.169806 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.169803 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8xns\" (UniqueName: \"kubernetes.io/projected/e67664dc-7e4f-4c13-9ffc-6a078c477c67-kube-api-access-b8xns\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:18:35.909176 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.909143 2555 generic.go:358] "Generic (PLEG): container finished" podID="e67664dc-7e4f-4c13-9ffc-6a078c477c67" containerID="a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48" exitCode=0 May 20 14:18:35.909381 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.909195 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-946f7964-hnbfj" May 20 14:18:35.909381 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.909213 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-946f7964-hnbfj" event={"ID":"e67664dc-7e4f-4c13-9ffc-6a078c477c67","Type":"ContainerDied","Data":"a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48"} May 20 14:18:35.909381 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.909247 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-946f7964-hnbfj" event={"ID":"e67664dc-7e4f-4c13-9ffc-6a078c477c67","Type":"ContainerDied","Data":"b27f14b990029f1f6da69e56682163146eab73b4080d18deb728fb9a7d6286e2"} May 20 14:18:35.909381 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.909266 2555 scope.go:117] "RemoveContainer" containerID="a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48" May 20 14:18:35.917900 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.917878 2555 scope.go:117] "RemoveContainer" containerID="a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48" May 20 14:18:35.918149 ip-10-0-142-178 kubenswrapper[2555]: E0520 14:18:35.918127 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48\": container with ID starting with a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48 not found: ID does not exist" containerID="a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48" May 20 14:18:35.918227 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.918158 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48"} err="failed to get container status \"a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48\": rpc error: code = NotFound desc = could not find container \"a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48\": container with ID starting with a619d48b2bc9258586aae26035770c6a96f1750f37dd45c9cac4c62c98e08f48 not found: ID does not exist" May 20 14:18:35.929124 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.929098 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-946f7964-hnbfj"] May 20 14:18:35.932671 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:35.932648 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-946f7964-hnbfj"] May 20 14:18:36.572715 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:18:36.572681 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67664dc-7e4f-4c13-9ffc-6a078c477c67" path="/var/lib/kubelet/pods/e67664dc-7e4f-4c13-9ffc-6a078c477c67/volumes" May 20 14:21:38.526456 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:21:38.526372 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:21:38.526997 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:21:38.526981 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:23:06.155214 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:23:06.155122 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:23:16.294020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:23:16.293984 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:23:25.404086 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:23:25.404044 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:23:35.268339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:23:35.268301 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:23:44.573024 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:23:44.572989 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:23:55.289321 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:23:55.289276 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:25:08.160493 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:25:08.160450 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:25:23.853734 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:25:23.853674 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:26:03.162952 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:26:03.162867 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:26:20.155880 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:26:20.155844 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:26:34.556584 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:26:34.556548 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:26:38.548786 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:26:38.548760 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:26:38.550300 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:26:38.550278 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:26:50.653870 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:26:50.653831 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:27:44.770351 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:27:44.770277 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:27:54.250529 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:27:54.250468 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:28:11.251265 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:28:11.251230 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:28:19.058877 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:28:19.058841 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:28:36.554649 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:28:36.554612 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:28:44.455707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:28:44.455668 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:29:17.467776 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:29:17.467684 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:29:25.851538 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:29:25.851488 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:29:34.354111 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:29:34.354071 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:29:42.949154 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:29:42.949111 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:29:50.855702 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:29:50.855661 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:29:59.156109 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:29:59.156072 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:30:00.142864 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.142832 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29654790-lpkdr"] May 20 14:30:00.143182 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.143170 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67664dc-7e4f-4c13-9ffc-6a078c477c67" containerName="authorino" May 20 14:30:00.143233 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.143183 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67664dc-7e4f-4c13-9ffc-6a078c477c67" containerName="authorino" May 20 14:30:00.143268 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.143249 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="e67664dc-7e4f-4c13-9ffc-6a078c477c67" containerName="authorino" May 20 14:30:00.146144 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.146114 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:00.148823 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.148805 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sdr7g\"" May 20 14:30:00.166772 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.166748 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29654790-lpkdr"] May 20 14:30:00.217886 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.217859 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957tc\" (UniqueName: \"kubernetes.io/projected/062656a5-3c25-4a72-896d-7345f8c890ff-kube-api-access-957tc\") pod \"maas-api-key-cleanup-29654790-lpkdr\" (UID: \"062656a5-3c25-4a72-896d-7345f8c890ff\") " pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:00.320777 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.320740 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-957tc\" (UniqueName: \"kubernetes.io/projected/062656a5-3c25-4a72-896d-7345f8c890ff-kube-api-access-957tc\") pod \"maas-api-key-cleanup-29654790-lpkdr\" (UID: \"062656a5-3c25-4a72-896d-7345f8c890ff\") " pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:00.329944 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.329912 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-957tc\" (UniqueName: \"kubernetes.io/projected/062656a5-3c25-4a72-896d-7345f8c890ff-kube-api-access-957tc\") pod \"maas-api-key-cleanup-29654790-lpkdr\" (UID: \"062656a5-3c25-4a72-896d-7345f8c890ff\") " pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:00.456718 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.456645 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:00.582226 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.582202 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29654790-lpkdr"] May 20 14:30:00.584745 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:30:00.584713 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062656a5_3c25_4a72_896d_7345f8c890ff.slice/crio-d7eedce59b7e55cc3d5b212732b683c72d94b5e65b495c4d436f616f51fb4a4f WatchSource:0}: Error finding container d7eedce59b7e55cc3d5b212732b683c72d94b5e65b495c4d436f616f51fb4a4f: Status 404 returned error can't find the container with id d7eedce59b7e55cc3d5b212732b683c72d94b5e65b495c4d436f616f51fb4a4f May 20 14:30:00.586396 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:00.586381 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:30:01.153070 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:01.153031 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" event={"ID":"062656a5-3c25-4a72-896d-7345f8c890ff","Type":"ContainerStarted","Data":"d7eedce59b7e55cc3d5b212732b683c72d94b5e65b495c4d436f616f51fb4a4f"} May 20 14:30:03.775665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:03.775627 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:30:05.169557 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:05.169519 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" event={"ID":"062656a5-3c25-4a72-896d-7345f8c890ff","Type":"ContainerStarted","Data":"94be31dce486939762dd4671eb6266095fdfc9282cd48f1cd2b626bdf89b83a4"} May 20 14:30:05.189011 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:05.188948 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" podStartSLOduration=1.074016715 podStartE2EDuration="5.188930974s" podCreationTimestamp="2026-05-20 14:30:00 +0000 UTC" firstStartedPulling="2026-05-20 14:30:00.586528993 +0000 UTC m=+1402.600080169" lastFinishedPulling="2026-05-20 14:30:04.701443254 +0000 UTC m=+1406.714994428" observedRunningTime="2026-05-20 14:30:05.187848117 +0000 UTC m=+1407.201399336" watchObservedRunningTime="2026-05-20 14:30:05.188930974 +0000 UTC m=+1407.202482169" May 20 14:30:06.174227 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:06.174188 2555 generic.go:358] "Generic (PLEG): container finished" podID="062656a5-3c25-4a72-896d-7345f8c890ff" containerID="94be31dce486939762dd4671eb6266095fdfc9282cd48f1cd2b626bdf89b83a4" exitCode=0 May 20 14:30:06.174641 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:06.174248 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" event={"ID":"062656a5-3c25-4a72-896d-7345f8c890ff","Type":"ContainerDied","Data":"94be31dce486939762dd4671eb6266095fdfc9282cd48f1cd2b626bdf89b83a4"} May 20 14:30:07.304669 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:07.304643 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:07.384491 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:07.384460 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-957tc\" (UniqueName: \"kubernetes.io/projected/062656a5-3c25-4a72-896d-7345f8c890ff-kube-api-access-957tc\") pod \"062656a5-3c25-4a72-896d-7345f8c890ff\" (UID: \"062656a5-3c25-4a72-896d-7345f8c890ff\") " May 20 14:30:07.386659 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:07.386633 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/062656a5-3c25-4a72-896d-7345f8c890ff-kube-api-access-957tc" (OuterVolumeSpecName: "kube-api-access-957tc") pod "062656a5-3c25-4a72-896d-7345f8c890ff" (UID: "062656a5-3c25-4a72-896d-7345f8c890ff"). InnerVolumeSpecName "kube-api-access-957tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:30:07.485969 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:07.485940 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-957tc\" (UniqueName: \"kubernetes.io/projected/062656a5-3c25-4a72-896d-7345f8c890ff-kube-api-access-957tc\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:30:07.972961 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:07.972929 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:30:08.182909 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:08.182877 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" event={"ID":"062656a5-3c25-4a72-896d-7345f8c890ff","Type":"ContainerDied","Data":"d7eedce59b7e55cc3d5b212732b683c72d94b5e65b495c4d436f616f51fb4a4f"} May 20 14:30:08.182909 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:08.182899 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654790-lpkdr" May 20 14:30:08.182909 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:08.182908 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7eedce59b7e55cc3d5b212732b683c72d94b5e65b495c4d436f616f51fb4a4f" May 20 14:30:21.393706 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:30:21.393621 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:09.659434 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:09.659400 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:13.663736 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:13.663705 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:20.258320 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:20.258286 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:29.249584 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:29.249551 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:37.361040 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:37.361008 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:38.578821 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:38.578791 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:31:38.580739 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:38.580720 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:31:47.550113 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:47.550072 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:31:55.958238 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:31:55.958155 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:04.357999 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:04.357960 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:12.456520 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:12.456482 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:21.155359 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:21.155322 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:30.657774 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:30.657740 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:39.262726 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:39.262688 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:48.075888 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:48.075853 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:32:55.855981 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:32:55.855944 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:33:04.753217 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:33:04.753187 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:33:13.470983 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:33:13.470945 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:33:22.457019 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:33:22.456942 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:33:31.464334 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:33:31.464302 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:35:47.564370 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:35:47.564328 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:35:52.862913 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:35:52.862872 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:36:20.460824 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:20.460787 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:36:26.565596 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:26.565493 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:36:35.765119 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:35.765080 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:36:38.603666 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:38.603640 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:36:38.606663 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:38.606642 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:36:46.366566 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:46.366526 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:36:55.654903 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:36:55.654869 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:37:05.760527 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:37:05.760476 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:37:14.562153 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:37:14.562116 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:37:25.066498 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:37:25.066463 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:37:34.353721 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:37:34.353683 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:37:43.958684 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:37:43.958643 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:37:54.253105 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:37:54.253025 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:38:26.394470 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:38:26.394435 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:39:10.152753 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:39:10.152717 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:39:17.870249 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:39:17.870205 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:39:27.160132 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:39:27.160046 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:39:36.963608 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:39:36.963568 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:39:46.959625 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:39:46.959574 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:39:57.063081 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:39:57.063043 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:40:05.761025 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:40:05.760988 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:40:13.559339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:40:13.559299 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:40:21.449085 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:40:21.449050 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:40:29.560965 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:40:29.560917 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:40:38.456553 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:40:38.456496 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:40:49.252749 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:40:49.252708 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:41:06.656885 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:06.656789 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:41:14.873975 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:14.873939 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:41:23.659525 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:23.659467 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:41:31.756959 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:31.756918 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:41:38.629182 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:38.629152 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:41:38.632412 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:38.632380 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nrmg_727cfc25-9233-4c78-aff7-ab457355d6bd/ovn-acl-logging/0.log" May 20 14:41:51.058477 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:51.058443 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:41:57.453967 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:41:57.453930 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:42:06.665386 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:42:06.665348 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:42:14.768182 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:42:14.768147 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:42:24.055775 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:42:24.055693 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:42:32.760473 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:42:32.760431 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:42:41.654111 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:42:41.654074 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:42:54.862449 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:42:54.862411 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:43:03.756681 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:43:03.756645 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:43:17.110956 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:43:17.110919 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:43:27.079486 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:43:27.079448 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:43:33.565984 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:43:33.565942 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:43:43.479176 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:43:43.479129 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:43:51.661423 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:43:51.661336 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:44:08.263339 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:44:08.263296 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:44:16.349249 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:44:16.349217 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:44:25.561600 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:44:25.561562 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:44:34.156122 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:44:34.156085 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:44:56.956593 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:44:56.956557 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:45:00.145091 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.145057 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29654805-c55vk"] May 20 14:45:00.145590 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.145570 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="062656a5-3c25-4a72-896d-7345f8c890ff" containerName="cleanup" May 20 14:45:00.145644 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.145594 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="062656a5-3c25-4a72-896d-7345f8c890ff" containerName="cleanup" May 20 14:45:00.145704 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.145694 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="062656a5-3c25-4a72-896d-7345f8c890ff" containerName="cleanup" May 20 14:45:00.148984 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.148967 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:00.151828 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.151805 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sdr7g\"" May 20 14:45:00.169345 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.169314 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29654805-c55vk"] May 20 14:45:00.266774 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.266736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44jg\" (UniqueName: \"kubernetes.io/projected/52168e90-8a59-4a31-9f27-2d018d253e5d-kube-api-access-f44jg\") pod \"maas-api-key-cleanup-29654805-c55vk\" (UID: \"52168e90-8a59-4a31-9f27-2d018d253e5d\") " pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:00.367609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.367560 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f44jg\" (UniqueName: \"kubernetes.io/projected/52168e90-8a59-4a31-9f27-2d018d253e5d-kube-api-access-f44jg\") pod \"maas-api-key-cleanup-29654805-c55vk\" (UID: \"52168e90-8a59-4a31-9f27-2d018d253e5d\") " pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:00.378451 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.378422 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44jg\" (UniqueName: \"kubernetes.io/projected/52168e90-8a59-4a31-9f27-2d018d253e5d-kube-api-access-f44jg\") pod \"maas-api-key-cleanup-29654805-c55vk\" (UID: \"52168e90-8a59-4a31-9f27-2d018d253e5d\") " pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:00.459668 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.459568 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:00.592791 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.592759 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29654805-c55vk"] May 20 14:45:00.596131 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:45:00.596107 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52168e90_8a59_4a31_9f27_2d018d253e5d.slice/crio-1b582dd260fb045e2cbc47031e6d449ddaa31773be40e364a14077ee297dcf7c WatchSource:0}: Error finding container 1b582dd260fb045e2cbc47031e6d449ddaa31773be40e364a14077ee297dcf7c: Status 404 returned error can't find the container with id 1b582dd260fb045e2cbc47031e6d449ddaa31773be40e364a14077ee297dcf7c May 20 14:45:00.597926 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:00.597904 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:45:01.150837 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:01.150750 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" event={"ID":"52168e90-8a59-4a31-9f27-2d018d253e5d","Type":"ContainerStarted","Data":"32958235ad79745061d30e77174c14b1eb91596bf3f388591ff8215d4decf2cc"} May 20 14:45:01.150837 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:01.150787 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" event={"ID":"52168e90-8a59-4a31-9f27-2d018d253e5d","Type":"ContainerStarted","Data":"1b582dd260fb045e2cbc47031e6d449ddaa31773be40e364a14077ee297dcf7c"} May 20 14:45:01.173290 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:01.173234 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" podStartSLOduration=1.173215315 podStartE2EDuration="1.173215315s" podCreationTimestamp="2026-05-20 14:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:45:01.171575427 +0000 UTC m=+2303.185126621" watchObservedRunningTime="2026-05-20 14:45:01.173215315 +0000 UTC m=+2303.186766511" May 20 14:45:02.155340 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:02.155297 2555 generic.go:358] "Generic (PLEG): container finished" podID="52168e90-8a59-4a31-9f27-2d018d253e5d" containerID="32958235ad79745061d30e77174c14b1eb91596bf3f388591ff8215d4decf2cc" exitCode=0 May 20 14:45:02.155768 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:02.155389 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" event={"ID":"52168e90-8a59-4a31-9f27-2d018d253e5d","Type":"ContainerDied","Data":"32958235ad79745061d30e77174c14b1eb91596bf3f388591ff8215d4decf2cc"} May 20 14:45:03.291960 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:03.291935 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:03.400674 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:03.400635 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f44jg\" (UniqueName: \"kubernetes.io/projected/52168e90-8a59-4a31-9f27-2d018d253e5d-kube-api-access-f44jg\") pod \"52168e90-8a59-4a31-9f27-2d018d253e5d\" (UID: \"52168e90-8a59-4a31-9f27-2d018d253e5d\") " May 20 14:45:03.402768 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:03.402736 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52168e90-8a59-4a31-9f27-2d018d253e5d-kube-api-access-f44jg" (OuterVolumeSpecName: "kube-api-access-f44jg") pod "52168e90-8a59-4a31-9f27-2d018d253e5d" (UID: "52168e90-8a59-4a31-9f27-2d018d253e5d"). InnerVolumeSpecName "kube-api-access-f44jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:45:03.501738 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:03.501699 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f44jg\" (UniqueName: \"kubernetes.io/projected/52168e90-8a59-4a31-9f27-2d018d253e5d-kube-api-access-f44jg\") on node \"ip-10-0-142-178.ec2.internal\" DevicePath \"\"" May 20 14:45:04.163242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:04.163214 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" May 20 14:45:04.163242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:04.163221 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654805-c55vk" event={"ID":"52168e90-8a59-4a31-9f27-2d018d253e5d","Type":"ContainerDied","Data":"1b582dd260fb045e2cbc47031e6d449ddaa31773be40e364a14077ee297dcf7c"} May 20 14:45:04.163242 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:04.163249 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b582dd260fb045e2cbc47031e6d449ddaa31773be40e364a14077ee297dcf7c" May 20 14:45:09.357400 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:09.357364 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-p49b2"] May 20 14:45:13.781455 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:13.781422 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29654790-lpkdr_062656a5-3c25-4a72-896d-7345f8c890ff/cleanup/0.log" May 20 14:45:13.900576 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:13.900543 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29654805-c55vk_52168e90-8a59-4a31-9f27-2d018d253e5d/cleanup/0.log" May 20 14:45:14.498752 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:14.498719 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fcff7bc4-vfrfc_fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de/manager/0.log" May 20 14:45:16.553558 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:16.553526 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-p49b2_4d57d20c-4110-4a9c-8632-9729d7b5f0da/limitador/0.log" May 20 14:45:17.308803 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:17.308770 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-587b5db545-6bzc2_33a0f625-0afc-4c2a-968b-9781a7c58b6d/kube-auth-proxy/0.log" May 20 14:45:18.163369 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:18.163344 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2_44170805-06c2-4269-9852-5c5abcb14201/storage-initializer/0.log" May 20 14:45:18.171953 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:18.171925 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-xtwg2_44170805-06c2-4269-9852-5c5abcb14201/main/0.log" May 20 14:45:18.684571 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:18.684544 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2_cf98b729-011f-4111-bcb2-15d0e5232f2b/storage-initializer/0.log" May 20 14:45:18.692391 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:18.692367 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-25mh2_cf98b729-011f-4111-bcb2-15d0e5232f2b/main/0.log" May 20 14:45:23.184459 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.184379 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc2rm/must-gather-kwzgv"] May 20 14:45:23.184806 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.184739 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52168e90-8a59-4a31-9f27-2d018d253e5d" containerName="cleanup" May 20 14:45:23.184806 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.184751 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="52168e90-8a59-4a31-9f27-2d018d253e5d" containerName="cleanup" May 20 14:45:23.184876 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.184815 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="52168e90-8a59-4a31-9f27-2d018d253e5d" containerName="cleanup" May 20 14:45:23.187707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.187689 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.191609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.191573 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bc2rm\"/\"default-dockercfg-g587b\"" May 20 14:45:23.191707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.191633 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc2rm\"/\"kube-root-ca.crt\"" May 20 14:45:23.191707 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.191654 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc2rm\"/\"openshift-service-ca.crt\"" May 20 14:45:23.200223 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.200204 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc2rm/must-gather-kwzgv"] May 20 14:45:23.258069 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.258043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e541a217-9af6-4300-a454-0204014aa23a-must-gather-output\") pod \"must-gather-kwzgv\" (UID: \"e541a217-9af6-4300-a454-0204014aa23a\") " pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.258195 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.258115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnd8k\" (UniqueName: \"kubernetes.io/projected/e541a217-9af6-4300-a454-0204014aa23a-kube-api-access-lnd8k\") pod \"must-gather-kwzgv\" (UID: \"e541a217-9af6-4300-a454-0204014aa23a\") " pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.359474 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.359449 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnd8k\" (UniqueName: \"kubernetes.io/projected/e541a217-9af6-4300-a454-0204014aa23a-kube-api-access-lnd8k\") pod \"must-gather-kwzgv\" (UID: \"e541a217-9af6-4300-a454-0204014aa23a\") " pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.359608 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.359522 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e541a217-9af6-4300-a454-0204014aa23a-must-gather-output\") pod \"must-gather-kwzgv\" (UID: \"e541a217-9af6-4300-a454-0204014aa23a\") " pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.359831 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.359814 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e541a217-9af6-4300-a454-0204014aa23a-must-gather-output\") pod \"must-gather-kwzgv\" (UID: \"e541a217-9af6-4300-a454-0204014aa23a\") " pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.368001 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.367974 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnd8k\" (UniqueName: \"kubernetes.io/projected/e541a217-9af6-4300-a454-0204014aa23a-kube-api-access-lnd8k\") pod \"must-gather-kwzgv\" (UID: \"e541a217-9af6-4300-a454-0204014aa23a\") " pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.496606 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.496583 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc2rm/must-gather-kwzgv" May 20 14:45:23.624134 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:23.624107 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc2rm/must-gather-kwzgv"] May 20 14:45:23.626754 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:45:23.626721 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode541a217_9af6_4300_a454_0204014aa23a.slice/crio-866a8a73084af61e5f714e86cea60bd3eb59e48bf07432c7a4c73a212d720e0c WatchSource:0}: Error finding container 866a8a73084af61e5f714e86cea60bd3eb59e48bf07432c7a4c73a212d720e0c: Status 404 returned error can't find the container with id 866a8a73084af61e5f714e86cea60bd3eb59e48bf07432c7a4c73a212d720e0c May 20 14:45:24.230936 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:24.230896 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/must-gather-kwzgv" event={"ID":"e541a217-9af6-4300-a454-0204014aa23a","Type":"ContainerStarted","Data":"866a8a73084af61e5f714e86cea60bd3eb59e48bf07432c7a4c73a212d720e0c"} May 20 14:45:25.237864 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:25.237809 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/must-gather-kwzgv" event={"ID":"e541a217-9af6-4300-a454-0204014aa23a","Type":"ContainerStarted","Data":"09eaaf303959909da55144b3fa0b661067f748583e6472392404872d7e3ae2fc"} May 20 14:45:25.238353 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:25.237905 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/must-gather-kwzgv" event={"ID":"e541a217-9af6-4300-a454-0204014aa23a","Type":"ContainerStarted","Data":"a2ec6ea8a041961971d549cc2c5e2aac9129d86ca2ebd31ff8cc21ea46bdba6c"} May 20 14:45:25.257803 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:25.257739 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bc2rm/must-gather-kwzgv" podStartSLOduration=1.4250706929999999 podStartE2EDuration="2.257716289s" podCreationTimestamp="2026-05-20 14:45:23 +0000 UTC" firstStartedPulling="2026-05-20 14:45:23.628554263 +0000 UTC m=+2325.642105437" lastFinishedPulling="2026-05-20 14:45:24.461199857 +0000 UTC m=+2326.474751033" observedRunningTime="2026-05-20 14:45:25.255655742 +0000 UTC m=+2327.269206937" watchObservedRunningTime="2026-05-20 14:45:25.257716289 +0000 UTC m=+2327.271267485" May 20 14:45:26.226544 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:26.226487 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fl7sz_df54abc0-d4ac-4103-94f7-94df3d3dc8f4/global-pull-secret-syncer/0.log" May 20 14:45:26.425810 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:26.425769 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4pkds_432fca58-c6aa-4cab-ba73-2ba20c9e2e18/konnectivity-agent/0.log" May 20 14:45:26.508019 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:26.507923 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-178.ec2.internal_3f931380657aab6a170cc5bfba4bab08/haproxy/0.log" May 20 14:45:31.225218 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:31.225185 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-p49b2_4d57d20c-4110-4a9c-8632-9729d7b5f0da/limitador/0.log" May 20 14:45:32.758042 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.757872 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/alertmanager/0.log" May 20 14:45:32.788124 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.788076 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/config-reloader/0.log" May 20 14:45:32.826722 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.825217 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/kube-rbac-proxy-web/0.log" May 20 14:45:32.872855 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.872747 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/kube-rbac-proxy/0.log" May 20 14:45:32.906140 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.906102 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/kube-rbac-proxy-metric/0.log" May 20 14:45:32.951563 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.951532 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/prom-label-proxy/0.log" May 20 14:45:32.977151 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:32.977026 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365257e-be7d-464b-927a-5a64957461de/init-config-reloader/0.log" May 20 14:45:33.032781 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.032747 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-spnkh_e6d76e9f-545d-441f-8084-2e96630e03c7/cluster-monitoring-operator/0.log" May 20 14:45:33.153946 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.153887 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-655b6486c-vb4r4_6be600d6-6159-453c-aec2-782bccbcd4ed/metrics-server/0.log" May 20 14:45:33.186939 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.186900 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-gbfxx_73bac66f-522b-4720-bb40-cac4cff8f754/monitoring-plugin/0.log" May 20 14:45:33.308212 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.308164 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4fd5_126a5903-06fa-49ed-9608-0c5d2a848a48/node-exporter/0.log" May 20 14:45:33.334895 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.334811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4fd5_126a5903-06fa-49ed-9608-0c5d2a848a48/kube-rbac-proxy/0.log" May 20 14:45:33.361850 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.361820 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4fd5_126a5903-06fa-49ed-9608-0c5d2a848a48/init-textfile/0.log" May 20 14:45:33.550689 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.550660 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/prometheus/0.log" May 20 14:45:33.583838 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.582407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/config-reloader/0.log" May 20 14:45:33.607947 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.607918 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/thanos-sidecar/0.log" May 20 14:45:33.637840 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.637805 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/kube-rbac-proxy-web/0.log" May 20 14:45:33.662871 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.662843 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/kube-rbac-proxy/0.log" May 20 14:45:33.689525 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.689483 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/kube-rbac-proxy-thanos/0.log" May 20 14:45:33.714774 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:33.714741 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de866c7c-05dc-487b-befe-47560ea431b9/init-config-reloader/0.log" May 20 14:45:34.703278 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.703235 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g"] May 20 14:45:34.709543 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.709498 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.718278 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.718248 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g"] May 20 14:45:34.791358 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.791325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-proc\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.791562 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.791364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-lib-modules\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.791562 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.791446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-podres\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.791665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.791561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5gn\" (UniqueName: \"kubernetes.io/projected/312ceeba-8537-4eed-875e-cb82f3caad7d-kube-api-access-7k5gn\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.791665 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.791618 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-sys\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892313 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892282 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-proc\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892313 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892317 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-lib-modules\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892340 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-podres\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892400 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5gn\" (UniqueName: \"kubernetes.io/projected/312ceeba-8537-4eed-875e-cb82f3caad7d-kube-api-access-7k5gn\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892429 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-sys\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892439 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-proc\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892550 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-sys\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892609 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892554 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-podres\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.892906 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.892632 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/312ceeba-8537-4eed-875e-cb82f3caad7d-lib-modules\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:34.902833 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:34.902801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5gn\" (UniqueName: \"kubernetes.io/projected/312ceeba-8537-4eed-875e-cb82f3caad7d-kube-api-access-7k5gn\") pod \"perf-node-gather-daemonset-cd28g\" (UID: \"312ceeba-8537-4eed-875e-cb82f3caad7d\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:35.022310 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:35.022273 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:35.197172 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:35.196406 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g"] May 20 14:45:35.208139 ip-10-0-142-178 kubenswrapper[2555]: W0520 14:45:35.208101 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod312ceeba_8537_4eed_875e_cb82f3caad7d.slice/crio-33cd2aab6cd25b84496f5200674db8712e8a2f88ef4224289d6a0101b5836c75 WatchSource:0}: Error finding container 33cd2aab6cd25b84496f5200674db8712e8a2f88ef4224289d6a0101b5836c75: Status 404 returned error can't find the container with id 33cd2aab6cd25b84496f5200674db8712e8a2f88ef4224289d6a0101b5836c75 May 20 14:45:35.287096 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:35.287059 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" event={"ID":"312ceeba-8537-4eed-875e-cb82f3caad7d","Type":"ContainerStarted","Data":"33cd2aab6cd25b84496f5200674db8712e8a2f88ef4224289d6a0101b5836c75"} May 20 14:45:36.292970 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:36.292927 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" event={"ID":"312ceeba-8537-4eed-875e-cb82f3caad7d","Type":"ContainerStarted","Data":"9d0b45e53d3bb1527da7ee2d4aeec592f232cbedc341c51748b257ffb73f03a9"} May 20 14:45:36.293469 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:36.293008 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:36.314757 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:36.314691 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" podStartSLOduration=2.314669761 podStartE2EDuration="2.314669761s" podCreationTimestamp="2026-05-20 14:45:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:45:36.311672663 +0000 UTC m=+2338.325223858" watchObservedRunningTime="2026-05-20 14:45:36.314669761 +0000 UTC m=+2338.328220958" May 20 14:45:37.613719 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:37.613687 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phjjw_b3f20d64-745b-43eb-ae14-2c56aa915574/dns/0.log" May 20 14:45:37.641113 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:37.641084 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phjjw_b3f20d64-745b-43eb-ae14-2c56aa915574/kube-rbac-proxy/0.log" May 20 14:45:37.742959 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:37.742930 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsvdz_5fd33346-cf67-4b07-9057-dc6075a620c7/dns-node-resolver/0.log" May 20 14:45:38.307815 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:38.307789 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pnxgt_8674ca5b-4b88-422c-9b77-50fb73dfef07/node-ca/0.log" May 20 14:45:39.318826 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:39.318803 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-587b5db545-6bzc2_33a0f625-0afc-4c2a-968b-9781a7c58b6d/kube-auth-proxy/0.log" May 20 14:45:40.065820 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:40.065790 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9zcc5_bb7c45fe-bb7e-4ae6-b673-2ebeaf85ce5f/serve-healthcheck-canary/0.log" May 20 14:45:40.857627 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:40.857597 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9rp9_e0005332-f594-49fe-a8d0-2ab0150de227/kube-rbac-proxy/0.log" May 20 14:45:40.885020 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:40.884991 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9rp9_e0005332-f594-49fe-a8d0-2ab0150de227/exporter/0.log" May 20 14:45:40.914992 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:40.914964 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9rp9_e0005332-f594-49fe-a8d0-2ab0150de227/extractor/0.log" May 20 14:45:42.306873 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:42.306846 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-cd28g" May 20 14:45:42.968263 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:42.968229 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29654790-lpkdr_062656a5-3c25-4a72-896d-7345f8c890ff/cleanup/0.log" May 20 14:45:43.001058 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:43.001018 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29654805-c55vk_52168e90-8a59-4a31-9f27-2d018d253e5d/cleanup/0.log" May 20 14:45:43.271446 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:43.271355 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fcff7bc4-vfrfc_fd4d06ee-4e2a-453c-adb8-6c86b5b9b5de/manager/0.log" May 20 14:45:44.766236 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:44.766207 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c6588f5c6-hzg49_ae91833c-1fd7-465b-9cac-5101c2442226/manager/0.log" May 20 14:45:49.310789 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:49.310757 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-kw955_d5a08567-7561-4db7-8ff6-5b2a4b219347/migrator/0.log" May 20 14:45:49.332207 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:49.332180 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-kw955_d5a08567-7561-4db7-8ff6-5b2a4b219347/graceful-termination/0.log" May 20 14:45:50.800261 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:50.800230 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7qjsz_b94e2ce1-cf19-421d-958b-f3f35ac7627f/kube-multus/0.log" May 20 14:45:51.190629 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.190550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/kube-multus-additional-cni-plugins/0.log" May 20 14:45:51.213744 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.213722 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/egress-router-binary-copy/0.log" May 20 14:45:51.235290 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.235266 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/cni-plugins/0.log" May 20 14:45:51.256556 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.256526 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/bond-cni-plugin/0.log" May 20 14:45:51.280170 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.280145 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/routeoverride-cni/0.log" May 20 14:45:51.302001 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.301971 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/whereabouts-cni-bincopy/0.log" May 20 14:45:51.324413 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.324389 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq89j_3a2bf97b-1e34-48d4-b216-e624c83db7d9/whereabouts-cni/0.log" May 20 14:45:51.471328 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.471294 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxsxj_2cd0dd56-cecd-4f98-a24d-5f18754736d3/network-metrics-daemon/0.log" May 20 14:45:51.499710 ip-10-0-142-178 kubenswrapper[2555]: I0520 14:45:51.499661 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxsxj_2cd0dd56-cecd-4f98-a24d-5f18754736d3/kube-rbac-proxy/0.log"