May 27 19:30:04.293272 ip-10-0-134-76 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 19:30:04.293282 ip-10-0-134-76 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 19:30:04.293290 ip-10-0-134-76 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 19:30:04.293572 ip-10-0-134-76 systemd[1]: Failed to start Kubernetes Kubelet. May 27 19:30:14.459554 ip-10-0-134-76 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 19:30:14.459574 ip-10-0-134-76 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2e2260643e164a76991ca9202d75a4ad -- May 27 19:32:36.086213 ip-10-0-134-76 systemd[1]: Starting Kubernetes Kubelet... May 27 19:32:36.585829 ip-10-0-134-76 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 19:32:36.585829 ip-10-0-134-76 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 19:32:36.585829 ip-10-0-134-76 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 19:32:36.585829 ip-10-0-134-76 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 19:32:36.585829 ip-10-0-134-76 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 19:32:36.587931 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.587831 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 19:32:36.596559 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596533 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:36.596559 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596553 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:36.596559 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596557 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:36.596559 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596560 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:36.596559 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596564 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596575 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596580 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596583 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596588 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596592 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596595 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596599 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596603 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596609 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596613 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596616 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596619 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596622 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596625 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596628 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596631 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596634 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596637 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:36.596758 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596639 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596642 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596647 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596650 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596652 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596655 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596658 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596660 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596663 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596665 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596669 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596671 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596674 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596676 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596679 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596685 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596688 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596690 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596693 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596696 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:36.597237 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596698 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596701 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596704 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596708 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596712 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596715 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596718 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596725 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596728 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596730 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596733 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596736 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596738 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596741 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596744 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596746 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596749 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596752 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596754 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596757 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:36.597716 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596762 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596765 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596768 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596771 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596774 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596777 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596780 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596783 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596786 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596789 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596792 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596798 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596801 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596804 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596807 2565 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596810 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596813 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596816 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596819 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596822 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:36.598239 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596824 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596827 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.596830 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597543 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597555 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597559 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597563 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597566 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597569 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597572 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597575 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597578 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597581 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597583 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597586 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597589 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597591 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597594 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597597 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597599 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:36.598717 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597602 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597605 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597607 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597610 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597612 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597615 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597617 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597620 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597623 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597628 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597632 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597635 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597638 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597641 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597643 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597646 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597650 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597652 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597655 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:36.599210 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597658 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597660 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597663 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597665 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597668 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597670 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597674 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597676 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597679 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597681 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597684 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597687 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597689 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597691 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597694 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597697 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597700 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597702 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597705 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597708 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:36.599672 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597711 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597716 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597719 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597721 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597724 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597727 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597730 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597732 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597735 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597738 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597740 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597743 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597746 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597748 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597751 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597753 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597757 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597759 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597762 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597765 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:36.600161 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597767 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597770 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597772 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597775 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597777 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597780 2565 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597783 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597785 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597788 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.597790 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597869 2565 flags.go:64] FLAG: --address="0.0.0.0" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597876 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597883 2565 flags.go:64] FLAG: --anonymous-auth="true" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597888 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597893 2565 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597896 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597916 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597920 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597924 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597927 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597931 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597934 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 19:32:36.600652 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597937 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597940 2565 flags.go:64] FLAG: --cgroup-root="" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597943 2565 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597947 2565 flags.go:64] FLAG: --client-ca-file="" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597949 2565 flags.go:64] FLAG: --cloud-config="" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597952 2565 flags.go:64] FLAG: --cloud-provider="external" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597955 2565 flags.go:64] FLAG: --cluster-dns="[]" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597960 2565 flags.go:64] FLAG: --cluster-domain="" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597963 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597966 2565 flags.go:64] FLAG: --config-dir="" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597969 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597973 2565 flags.go:64] FLAG: --container-log-max-files="5" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597977 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597980 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597983 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597986 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597989 2565 flags.go:64] FLAG: --contention-profiling="false" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597992 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597995 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.597999 2565 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598001 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598005 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598008 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598012 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598015 2565 flags.go:64] FLAG: --enable-load-reader="false" May 27 19:32:36.601197 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598019 2565 flags.go:64] FLAG: --enable-server="true" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598022 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598027 2565 flags.go:64] FLAG: --event-burst="100" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598030 2565 flags.go:64] FLAG: --event-qps="50" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598033 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598036 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598040 2565 flags.go:64] FLAG: --eviction-hard="" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598044 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598047 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598050 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598053 2565 flags.go:64] FLAG: --eviction-soft="" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598056 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598059 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598062 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598065 2565 flags.go:64] FLAG: --experimental-mounter-path="" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598068 2565 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598071 2565 flags.go:64] FLAG: --fail-swap-on="true" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598074 2565 flags.go:64] FLAG: --feature-gates="" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598078 2565 flags.go:64] FLAG: --file-check-frequency="20s" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598081 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598084 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598087 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598090 2565 flags.go:64] FLAG: --healthz-port="10248" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598093 2565 flags.go:64] FLAG: --help="false" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598096 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-76.ec2.internal" May 27 19:32:36.601799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598099 2565 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598102 2565 flags.go:64] FLAG: --http-check-frequency="20s" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598105 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598108 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598112 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598115 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598118 2565 flags.go:64] FLAG: --image-service-endpoint="" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598120 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598124 2565 flags.go:64] FLAG: --kube-api-burst="100" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598127 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598130 2565 flags.go:64] FLAG: --kube-api-qps="50" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598133 2565 flags.go:64] FLAG: --kube-reserved="" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598136 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598139 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598142 2565 flags.go:64] FLAG: --kubelet-cgroups="" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598144 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598147 2565 flags.go:64] FLAG: --lock-file="" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598150 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598154 2565 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598157 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598167 2565 flags.go:64] FLAG: --log-json-split-stream="false" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598170 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598173 2565 flags.go:64] FLAG: --log-text-split-stream="false" May 27 19:32:36.602412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598176 2565 flags.go:64] FLAG: --logging-format="text" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598179 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598182 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598185 2565 flags.go:64] FLAG: --manifest-url="" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598188 2565 flags.go:64] FLAG: --manifest-url-header="" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598192 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598195 2565 flags.go:64] FLAG: --max-open-files="1000000" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598199 2565 flags.go:64] FLAG: --max-pods="110" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598203 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598206 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598209 2565 flags.go:64] FLAG: --memory-manager-policy="None" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598212 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598215 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598218 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598221 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598228 2565 flags.go:64] FLAG: --node-status-max-images="50" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598231 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598234 2565 flags.go:64] FLAG: --oom-score-adj="-999" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598238 2565 flags.go:64] FLAG: --pod-cidr="" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598241 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598247 2565 flags.go:64] FLAG: --pod-manifest-path="" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598254 2565 flags.go:64] FLAG: --pod-max-pids="-1" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598257 2565 flags.go:64] FLAG: --pods-per-core="0" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598260 2565 flags.go:64] FLAG: --port="10250" May 27 19:32:36.603008 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598263 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598266 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-008aec0e1b82ae82c" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598270 2565 flags.go:64] FLAG: --qos-reserved="" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598273 2565 flags.go:64] FLAG: --read-only-port="10255" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598276 2565 flags.go:64] FLAG: --register-node="true" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598279 2565 flags.go:64] FLAG: --register-schedulable="true" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598282 2565 flags.go:64] FLAG: --register-with-taints="" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598286 2565 flags.go:64] FLAG: --registry-burst="10" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598289 2565 flags.go:64] FLAG: --registry-qps="5" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598291 2565 flags.go:64] FLAG: --reserved-cpus="" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598294 2565 flags.go:64] FLAG: --reserved-memory="" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598298 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598301 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598304 2565 flags.go:64] FLAG: --rotate-certificates="false" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598307 2565 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598310 2565 flags.go:64] FLAG: --runonce="false" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598313 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598316 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598318 2565 flags.go:64] FLAG: --seccomp-default="false" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598322 2565 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598324 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598327 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598331 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598334 2565 flags.go:64] FLAG: --storage-driver-password="root" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598337 2565 flags.go:64] FLAG: --storage-driver-secure="false" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598340 2565 flags.go:64] FLAG: --storage-driver-table="stats" May 27 19:32:36.603599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598343 2565 flags.go:64] FLAG: --storage-driver-user="root" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598347 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598350 2565 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598354 2565 flags.go:64] FLAG: --system-cgroups="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598357 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598362 2565 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598365 2565 flags.go:64] FLAG: --tls-cert-file="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598368 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598372 2565 flags.go:64] FLAG: --tls-min-version="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598375 2565 flags.go:64] FLAG: --tls-private-key-file="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598378 2565 flags.go:64] FLAG: --topology-manager-policy="none" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598381 2565 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598384 2565 flags.go:64] FLAG: --topology-manager-scope="container" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598387 2565 flags.go:64] FLAG: --v="2" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598391 2565 flags.go:64] FLAG: --version="false" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598396 2565 flags.go:64] FLAG: --vmodule="" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598400 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.598403 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598498 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598502 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598505 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598508 2565 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598512 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:36.604220 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598516 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598519 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598523 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598526 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598529 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598532 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598535 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598537 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598540 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598542 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598545 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598548 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598552 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598555 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598557 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598560 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598563 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598566 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598569 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598571 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:36.604785 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598574 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598577 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598581 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598584 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598586 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598589 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598592 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598594 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598597 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598600 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598602 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598605 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598608 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598610 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598613 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598615 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598618 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598621 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598623 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598626 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:36.605314 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598628 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598631 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598633 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598636 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598640 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598643 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598646 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598648 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598651 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598654 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598656 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598659 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598662 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598664 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598668 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598671 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598673 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598676 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598679 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598681 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:36.605798 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598684 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598686 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598689 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598692 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598694 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598697 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598699 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598702 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598705 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598707 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598709 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598712 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598715 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598717 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598720 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598722 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598726 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598729 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598732 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598735 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:36.606305 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.598737 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.599734 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.606440 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.606455 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606502 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606508 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606511 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606515 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606518 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606521 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606524 2565 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606527 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606530 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606532 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606535 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606538 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:36.606835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606540 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606543 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606546 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606548 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606551 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606554 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606556 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606559 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606561 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606564 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606567 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606569 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606572 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606575 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606578 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606581 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606583 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606586 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606588 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606593 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:36.607257 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606596 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606599 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606601 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606604 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606606 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606609 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606611 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606614 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606618 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606622 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606625 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606628 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606631 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606635 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606638 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606641 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606644 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606648 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606650 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:36.607741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606653 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606656 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606659 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606661 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606664 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606666 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606670 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606673 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606675 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606678 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606680 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606683 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606686 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606689 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606692 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606695 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606697 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606700 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606702 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606705 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:36.608218 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606708 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606710 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606713 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606715 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606718 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606720 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606723 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606725 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606728 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606730 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606733 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606736 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606739 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606741 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606744 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.606749 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 19:32:36.608720 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606865 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606871 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606874 2565 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606878 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606881 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606885 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606888 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606891 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606895 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606897 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606917 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606920 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606923 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606926 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606928 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606931 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606934 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606936 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606939 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606941 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:36.609144 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606944 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606947 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606949 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606952 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606955 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606958 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606960 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606963 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606965 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606968 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606970 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606973 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606975 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606979 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606982 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606984 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606986 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606989 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606992 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606994 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:36.609632 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.606997 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607000 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607002 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607006 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607008 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607011 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607013 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607016 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607019 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607021 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607024 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607027 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607029 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607032 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607034 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607038 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607041 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607045 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607047 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:36.610248 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607050 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607053 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607056 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607058 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607061 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607063 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607066 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607069 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607071 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607074 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607076 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607079 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607082 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607084 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607087 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607089 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607092 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607095 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607097 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607100 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:36.610712 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607102 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607105 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607107 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607110 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607113 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607115 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:36.607117 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.607122 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 19:32:36.611208 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.608007 2565 server.go:962] "Client rotation is on, will bootstrap in background" May 27 19:32:36.611453 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.611439 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 19:32:36.612673 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.612662 2565 server.go:1019] "Starting client certificate rotation" May 27 19:32:36.612775 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.612758 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 19:32:36.612805 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.612794 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 19:32:36.640318 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.640300 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 19:32:36.644141 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.644122 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 19:32:36.663425 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.663398 2565 log.go:25] "Validated CRI v1 runtime API" May 27 19:32:36.669630 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.669613 2565 log.go:25] "Validated CRI v1 image API" May 27 19:32:36.670769 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.670748 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 19:32:36.671746 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.671730 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 19:32:36.674193 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.674175 2565 fs.go:135] Filesystem UUIDs: map[577b495b-cc21-4f97-9296-22a9229b4295:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b069b8fa-4e3a-474f-969f-324965372293:/dev/nvme0n1p3] May 27 19:32:36.674254 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.674193 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 19:32:36.678389 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.678276 2565 manager.go:217] Machine: {Timestamp:2026-05-27 19:32:36.677774523 +0000 UTC m=+0.456301886 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103808 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26478daba7a575a5a79ee6402d2bad SystemUUID:ec26478d-aba7-a575-a5a7-9ee6402d2bad BootID:2e226064-3e16-4a76-991c-a9202d75a4ad Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c9:94:92:41:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c9:94:92:41:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:a3:ce:96:b4:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 19:32:36.679162 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.679150 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 19:32:36.679246 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.679234 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 19:32:36.682985 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.682961 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 19:32:36.683128 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.682990 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 19:32:36.683186 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.683138 2565 topology_manager.go:138] "Creating topology manager with none policy" May 27 19:32:36.683186 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.683147 2565 container_manager_linux.go:306] "Creating device plugin manager" May 27 19:32:36.683186 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.683155 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 19:32:36.684031 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.684021 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 19:32:36.686038 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.686027 2565 state_mem.go:36] "Initialized new in-memory state store" May 27 19:32:36.686150 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.686141 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 19:32:36.688860 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.688850 2565 kubelet.go:491] "Attempting to sync node with API server" May 27 19:32:36.688912 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.688864 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 19:32:36.688912 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.688876 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 19:32:36.688912 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.688885 2565 kubelet.go:397] "Adding apiserver pod source" May 27 19:32:36.688912 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.688893 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 19:32:36.690130 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.690119 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 19:32:36.690175 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.690138 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 19:32:36.693435 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.693420 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 19:32:36.695302 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.695285 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2d2jw" May 27 19:32:36.695757 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.695741 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 19:32:36.697990 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.697976 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.697998 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698007 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698016 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698029 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698038 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698047 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698055 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 19:32:36.698067 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698066 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 19:32:36.698311 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698075 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 19:32:36.698311 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698096 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 19:32:36.698311 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.698106 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 19:32:36.699122 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.699111 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 19:32:36.699179 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.699125 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 19:32:36.701642 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.701616 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 19:32:36.701712 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.701660 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 19:32:36.701760 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.701749 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 19:32:36.702174 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.702157 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 19:32:36.702313 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.702203 2565 server.go:1295] "Started kubelet" May 27 19:32:36.702313 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.702267 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 19:32:36.702392 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.702339 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 19:32:36.702433 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.702397 2565 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 19:32:36.703021 ip-10-0-134-76 systemd[1]: Started Kubernetes Kubelet. May 27 19:32:36.706668 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.706577 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 19:32:36.706847 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.706824 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2d2jw" May 27 19:32:36.708253 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.708237 2565 server.go:317] "Adding debug handlers to kubelet server" May 27 19:32:36.712514 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.711409 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-76.ec2.internal.18b38309ff4593f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-76.ec2.internal,UID:ip-10-0-134-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-76.ec2.internal,},FirstTimestamp:2026-05-27 19:32:36.702172153 +0000 UTC m=+0.480699520,LastTimestamp:2026-05-27 19:32:36.702172153 +0000 UTC m=+0.480699520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-76.ec2.internal,}" May 27 19:32:36.717009 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.716979 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 19:32:36.720938 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.720922 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 19:32:36.721570 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.721557 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 19:32:36.721713 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.721698 2565 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 19:32:36.721765 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.721714 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 19:32:36.721813 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.721781 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 19:32:36.721884 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.721859 2565 reconstruct.go:97] "Volume reconstruction finished" May 27 19:32:36.721884 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.721880 2565 reconciler.go:26] "Reconciler: start to sync state" May 27 19:32:36.722211 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722187 2565 factory.go:55] Registering systemd factory May 27 19:32:36.722211 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722204 2565 factory.go:223] Registration of the systemd container factory successfully May 27 19:32:36.722412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722400 2565 factory.go:153] Registering CRI-O factory May 27 19:32:36.722468 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722416 2565 factory.go:223] Registration of the crio container factory successfully May 27 19:32:36.722517 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722469 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 19:32:36.722517 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722489 2565 factory.go:103] Registering Raw factory May 27 19:32:36.722517 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.722504 2565 manager.go:1196] Started watching for new ooms in manager May 27 19:32:36.722517 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.722499 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:36.723089 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.723072 2565 manager.go:319] Starting recovery of all containers May 27 19:32:36.724627 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.724607 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:36.727109 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.727078 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-76.ec2.internal\" not found" node="ip-10-0-134-76.ec2.internal" May 27 19:32:36.733187 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.733065 2565 manager.go:324] Recovery completed May 27 19:32:36.737267 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.737255 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:36.738832 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.738808 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:36.738926 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.738837 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:36.738926 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.738846 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:36.739351 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.739339 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 19:32:36.739396 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.739351 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 19:32:36.739396 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.739367 2565 state_mem.go:36] "Initialized new in-memory state store" May 27 19:32:36.743021 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.743009 2565 policy_none.go:49] "None policy: Start" May 27 19:32:36.743066 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.743025 2565 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 19:32:36.743066 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.743035 2565 state_mem.go:35] "Initializing new in-memory state store" May 27 19:32:36.780594 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.780577 2565 manager.go:341] "Starting Device Plugin manager" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.780611 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.780620 2565 server.go:85] "Starting device plugin registration server" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.780859 2565 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.780874 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.780965 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.781065 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.781077 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.781548 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 19:32:36.802815 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.781583 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:36.847672 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.847609 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 19:32:36.848814 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.848798 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 19:32:36.848886 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.848824 2565 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 19:32:36.848886 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.848842 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 19:32:36.848886 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.848853 2565 kubelet.go:2451] "Starting kubelet main sync loop" May 27 19:32:36.849026 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.848896 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 19:32:36.855953 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.855886 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:36.881816 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.881796 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:36.882655 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.882629 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:36.882734 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.882660 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:36.882734 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.882675 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:36.882734 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.882701 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-76.ec2.internal" May 27 19:32:36.888635 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.888620 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-76.ec2.internal" May 27 19:32:36.888684 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.888642 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-76.ec2.internal\": node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:36.905569 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.905550 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:36.949001 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.948964 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal"] May 27 19:32:36.949086 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.949041 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:36.949803 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.949789 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:36.949849 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.949815 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:36.949849 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.949825 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:36.950962 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.950950 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:36.951114 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951099 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:36.951175 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951131 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:36.951642 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951626 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:36.951705 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951643 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:36.951705 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951651 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:36.951705 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951662 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:36.951705 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951664 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:36.951705 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.951678 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:36.952731 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.952716 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" May 27 19:32:36.952798 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.952740 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:36.953317 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.953301 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:36.953380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.953329 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:36.953380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:36.953341 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:36.977426 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.977408 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-76.ec2.internal\" not found" node="ip-10-0-134-76.ec2.internal" May 27 19:32:36.981714 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:36.981699 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-76.ec2.internal\" not found" node="ip-10-0-134-76.ec2.internal" May 27 19:32:37.005752 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.005737 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.023073 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.023056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba4e04f982c43cab08db5ae0812c9c68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal\" (UID: \"ba4e04f982c43cab08db5ae0812c9c68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.023133 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.023080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4e04f982c43cab08db5ae0812c9c68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal\" (UID: \"ba4e04f982c43cab08db5ae0812c9c68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.023133 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.023097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0364653ed866562d9f25e010755536fc-config\") pod \"kube-apiserver-proxy-ip-10-0-134-76.ec2.internal\" (UID: \"0364653ed866562d9f25e010755536fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" May 27 19:32:37.106643 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.106593 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.123859 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.123839 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba4e04f982c43cab08db5ae0812c9c68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal\" (UID: \"ba4e04f982c43cab08db5ae0812c9c68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.123940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.123870 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4e04f982c43cab08db5ae0812c9c68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal\" (UID: \"ba4e04f982c43cab08db5ae0812c9c68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.123940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.123897 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0364653ed866562d9f25e010755536fc-config\") pod \"kube-apiserver-proxy-ip-10-0-134-76.ec2.internal\" (UID: \"0364653ed866562d9f25e010755536fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" May 27 19:32:37.123940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.123918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba4e04f982c43cab08db5ae0812c9c68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal\" (UID: \"ba4e04f982c43cab08db5ae0812c9c68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.124047 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.123947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4e04f982c43cab08db5ae0812c9c68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal\" (UID: \"ba4e04f982c43cab08db5ae0812c9c68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.124047 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.123967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0364653ed866562d9f25e010755536fc-config\") pod \"kube-apiserver-proxy-ip-10-0-134-76.ec2.internal\" (UID: \"0364653ed866562d9f25e010755536fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" May 27 19:32:37.207255 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.207224 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.279712 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.279679 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:37.284299 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.284286 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" May 27 19:32:37.307965 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.307941 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.408492 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.408441 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.508912 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.508875 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.609443 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.609418 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.612580 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.612557 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 19:32:37.612739 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.612721 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 19:32:37.612775 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.612721 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 19:32:37.710249 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.710224 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.711330 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.711294 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 19:27:36 +0000 UTC" deadline="2027-12-23 10:09:44.02566096 +0000 UTC" May 27 19:32:37.711330 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.711322 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13790h37m6.314342212s" May 27 19:32:37.721133 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.721113 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 19:32:37.732391 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.732369 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 19:32:37.751015 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.750994 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cr5q8" May 27 19:32:37.760214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.760196 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cr5q8" May 27 19:32:37.761842 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.761828 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:37.811086 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.811067 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:37.833568 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:37.833532 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4e04f982c43cab08db5ae0812c9c68.slice/crio-ad813fe3bda7d5efbb9743d7a9ab093fae085082e58a7790a5c58f84d0d79038 WatchSource:0}: Error finding container ad813fe3bda7d5efbb9743d7a9ab093fae085082e58a7790a5c58f84d0d79038: Status 404 returned error can't find the container with id ad813fe3bda7d5efbb9743d7a9ab093fae085082e58a7790a5c58f84d0d79038 May 27 19:32:37.833769 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:37.833750 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0364653ed866562d9f25e010755536fc.slice/crio-5e8fce53671dfc754964144b724fdc1671643baac673f0af0677577a38a91480 WatchSource:0}: Error finding container 5e8fce53671dfc754964144b724fdc1671643baac673f0af0677577a38a91480: Status 404 returned error can't find the container with id 5e8fce53671dfc754964144b724fdc1671643baac673f0af0677577a38a91480 May 27 19:32:37.836819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.836803 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:32:37.852283 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.852247 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" event={"ID":"ba4e04f982c43cab08db5ae0812c9c68","Type":"ContainerStarted","Data":"ad813fe3bda7d5efbb9743d7a9ab093fae085082e58a7790a5c58f84d0d79038"} May 27 19:32:37.853095 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:37.853075 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" event={"ID":"0364653ed866562d9f25e010755536fc","Type":"ContainerStarted","Data":"5e8fce53671dfc754964144b724fdc1671643baac673f0af0677577a38a91480"} May 27 19:32:37.911309 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:37.911287 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:38.011801 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.011745 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:38.112219 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.112176 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-76.ec2.internal\" not found" May 27 19:32:38.135417 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.135399 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:38.222740 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.222717 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" May 27 19:32:38.238927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.238890 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 19:32:38.240043 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.240028 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" May 27 19:32:38.247387 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.247371 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 19:32:38.664088 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.664057 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:38.689215 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.689189 2565 apiserver.go:52] "Watching apiserver" May 27 19:32:38.698486 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.698458 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 19:32:38.698866 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.698839 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w","openshift-multus/multus-additional-cni-plugins-7hj5r","openshift-multus/multus-t6cnk","openshift-multus/network-metrics-daemon-ssjlj","openshift-network-diagnostics/network-check-target-4dcwc","openshift-ovn-kubernetes/ovnkube-node-zpjx2","kube-system/konnectivity-agent-bz9w8","kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zn27q","openshift-dns/node-resolver-l58z4","openshift-image-registry/node-ca-4hsf5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal","openshift-network-operator/iptables-alerter-mqgpn"] May 27 19:32:38.701936 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.701895 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.703999 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.703976 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.704660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.704634 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 19:32:38.704873 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.704852 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 19:32:38.705174 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.705155 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 19:32:38.705340 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.705316 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjdl5\"" May 27 19:32:38.705474 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.705431 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 19:32:38.705474 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.705436 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 19:32:38.705601 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.705557 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 19:32:38.706164 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.706147 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.706739 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.706720 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 19:32:38.707010 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.706977 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 19:32:38.707093 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.707022 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 19:32:38.707093 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.707051 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 19:32:38.707210 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.706977 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qb6t4\"" May 27 19:32:38.707262 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.707247 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 19:32:38.708580 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.708553 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 19:32:38.708686 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.708667 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j8pt4\"" May 27 19:32:38.708749 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.708705 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:38.708804 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.708780 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:38.709075 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.709057 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 19:32:38.709146 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.709081 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 19:32:38.711077 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.710941 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.713118 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.713100 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:38.713209 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.713166 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:38.713276 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.713228 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 19:32:38.713492 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.713476 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 19:32:38.713553 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.713495 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-87b9h\"" May 27 19:32:38.715479 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.715460 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.718096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.717772 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.718096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.717958 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 19:32:38.718241 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.718200 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 19:32:38.718315 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.718302 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 19:32:38.718471 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.718404 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-khm89\"" May 27 19:32:38.720733 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.720298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.720733 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.720313 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmwx9\"" May 27 19:32:38.720733 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.720443 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 19:32:38.720733 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.720584 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 19:32:38.722565 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.722549 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.724449 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.724052 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 19:32:38.724449 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.724122 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 19:32:38.724695 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.724674 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76w72\"" May 27 19:32:38.726246 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.725559 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6cnk" May 27 19:32:38.726246 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.725733 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 19:32:38.726396 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.726354 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4t7fz\"" May 27 19:32:38.726555 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.726539 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 19:32:38.726674 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.726658 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 19:32:38.730562 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.730542 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 19:32:38.731334 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731317 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bs9j2\"" May 27 19:32:38.731425 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.731425 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbjx\" (UniqueName: \"kubernetes.io/projected/ad9e6780-697b-406e-bf58-b55ed5712173-kube-api-access-8mbjx\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.731425 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-run-netns\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.731425 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-host\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-host\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-sys\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-ovnkube-script-lib\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-systemd\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-os-release\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731534 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-socket-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a37b93b-7bef-46f7-b4e9-13cb3520156c-hosts-file\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.731620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nrt\" (UniqueName: \"kubernetes.io/projected/9341beac-d749-44e8-91dc-37fc304f9193-kube-api-access-p7nrt\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ad9e6780-697b-406e-bf58-b55ed5712173-iptables-alerter-script\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad9e6780-697b-406e-bf58-b55ed5712173-host-slash\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-systemd-units\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtm9\" (UniqueName: \"kubernetes.io/projected/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-kube-api-access-sjtm9\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysctl-conf\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-env-overrides\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-slash\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-log-socket\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs9st\" (UniqueName: \"kubernetes.io/projected/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-kube-api-access-gs9st\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-lib-modules\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.731998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9brn5\" (UniqueName: \"kubernetes.io/projected/49194680-201d-4776-a235-393aeb8ee8d6-kube-api-access-9brn5\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.732064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-var-lib-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndz6\" (UniqueName: \"kubernetes.io/projected/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-kube-api-access-8ndz6\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-modprobe-d\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-device-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysctl-d\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a37b93b-7bef-46f7-b4e9-13cb3520156c-tmp-dir\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl5cm\" (UniqueName: \"kubernetes.io/projected/7a37b93b-7bef-46f7-b4e9-13cb3520156c-kube-api-access-dl5cm\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cnibin\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-kubelet\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-node-log\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-registration-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49194680-201d-4776-a235-393aeb8ee8d6-tmp\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-etc-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.732772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-system-cni-dir\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-kubernetes\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-ovnkube-config\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16-agent-certs\") pod \"konnectivity-agent-bz9w8\" (UID: \"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16\") " pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-ovn\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-cni-netd\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-sys-fs\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-systemd\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9341beac-d749-44e8-91dc-37fc304f9193-ovn-node-metrics-cert\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16-konnectivity-ca\") pod \"konnectivity-agent-bz9w8\" (UID: \"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16\") " pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-etc-selinux\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.732995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-run\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.733018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-var-lib-kubelet\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.733485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.733040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49194680-201d-4776-a235-393aeb8ee8d6-etc-tuned\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.734140 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.733062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54sr\" (UniqueName: \"kubernetes.io/projected/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-kube-api-access-d54sr\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:38.734140 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.733101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-cni-bin\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.734140 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.733129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysconfig\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.734140 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.733153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-serviceca\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.760840 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.760815 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 19:27:37 +0000 UTC" deadline="2027-11-22 13:17:27.325344131 +0000 UTC" May 27 19:32:38.760840 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.760837 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13049h44m48.564509832s" May 27 19:32:38.801310 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.801290 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:38.822868 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.822845 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 19:32:38.833794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833771 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a37b93b-7bef-46f7-b4e9-13cb3520156c-tmp-dir\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.833893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833800 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl5cm\" (UniqueName: \"kubernetes.io/projected/7a37b93b-7bef-46f7-b4e9-13cb3520156c-kube-api-access-dl5cm\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.833893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833825 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cnibin\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.833893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-cni-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.833893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833887 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-cni-multus\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cnibin\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-kubelet\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.833980 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-kubelet\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834005 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-node-log\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834030 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-registration-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-kubelet\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834055 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49194680-201d-4776-a235-393aeb8ee8d6-tmp\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.834106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/076cfd02-ac02-43cf-bc22-6548333bd8d6-cni-binary-copy\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-node-log\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834117 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-registration-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834164 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a37b93b-7bef-46f7-b4e9-13cb3520156c-tmp-dir\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-etc-kubernetes\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834248 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-etc-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834275 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834301 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-system-cni-dir\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834324 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834326 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-etc-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834350 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-kubernetes\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834349 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834402 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-kubernetes\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.834455 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-socket-dir-parent\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvqc\" (UniqueName: \"kubernetes.io/projected/076cfd02-ac02-43cf-bc22-6548333bd8d6-kube-api-access-4tvqc\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834498 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-ovnkube-config\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834523 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16-agent-certs\") pod \"konnectivity-agent-bz9w8\" (UID: \"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16\") " pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834551 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-ovn\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834575 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-cni-netd\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834700 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-sys-fs\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834736 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-systemd\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834765 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834792 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9341beac-d749-44e8-91dc-37fc304f9193-ovn-node-metrics-cert\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-cni-netd\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834801 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834819 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16-konnectivity-ca\") pod \"konnectivity-agent-bz9w8\" (UID: \"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16\") " pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-system-cni-dir\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-sys-fs\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834864 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-etc-selinux\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.835152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834896 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-run\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834942 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-var-lib-kubelet\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834966 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49194680-201d-4776-a235-393aeb8ee8d6-etc-tuned\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834993 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d54sr\" (UniqueName: \"kubernetes.io/projected/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-kube-api-access-d54sr\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835018 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-cni-bin\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835044 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysconfig\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835068 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-serviceca\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-systemd\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-os-release\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-hostroot\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835148 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-ovnkube-config\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835193 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbjx\" (UniqueName: \"kubernetes.io/projected/ad9e6780-697b-406e-bf58-b55ed5712173-kube-api-access-8mbjx\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.834792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-cni-bin\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835250 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-run-netns\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.835958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-run\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835275 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-host\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-host\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835322 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-sys\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835347 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16-konnectivity-ca\") pod \"konnectivity-agent-bz9w8\" (UID: \"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16\") " pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-var-lib-kubelet\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835348 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-ovnkube-script-lib\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835387 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-cni-bin\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-systemd\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835436 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-os-release\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835462 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-etc-selinux\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835502 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-socket-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835530 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a37b93b-7bef-46f7-b4e9-13cb3520156c-hosts-file\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-host\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835556 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nrt\" (UniqueName: \"kubernetes.io/projected/9341beac-d749-44e8-91dc-37fc304f9193-kube-api-access-p7nrt\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.836724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835582 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ad9e6780-697b-406e-bf58-b55ed5712173-iptables-alerter-script\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835608 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad9e6780-697b-406e-bf58-b55ed5712173-host-slash\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835634 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-systemd-units\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835675 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtm9\" (UniqueName: \"kubernetes.io/projected/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-kube-api-access-sjtm9\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835701 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysctl-conf\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-system-cni-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-cnibin\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835799 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-sys\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835799 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-env-overrides\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835840 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835866 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-slash\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835890 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-log-socket\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835961 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs9st\" (UniqueName: \"kubernetes.io/projected/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-kube-api-access-gs9st\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.835984 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-lib-modules\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836009 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9brn5\" (UniqueName: \"kubernetes.io/projected/49194680-201d-4776-a235-393aeb8ee8d6-kube-api-access-9brn5\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836036 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-var-lib-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.837505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836070 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836103 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndz6\" (UniqueName: \"kubernetes.io/projected/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-kube-api-access-8ndz6\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-k8s-cni-cncf-io\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-netns\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-multus-certs\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836213 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-modprobe-d\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-run-netns\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-daemon-config\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836274 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-device-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-env-overrides\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836423 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-host\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysconfig\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836515 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysctl-d\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-systemd-units\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836560 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-conf-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a37b93b-7bef-46f7-b4e9-13cb3520156c-hosts-file\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.838275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ad9e6780-697b-406e-bf58-b55ed5712173-iptables-alerter-script\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysctl-conf\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.836995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-lib-modules\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-device-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-host-slash\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-systemd\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-log-socket\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9341beac-d749-44e8-91dc-37fc304f9193-ovnkube-script-lib\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-os-release\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837265 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-var-lib-openvswitch\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad9e6780-697b-406e-bf58-b55ed5712173-host-slash\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837313 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-modprobe-d\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837573 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-socket-dir\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49194680-201d-4776-a235-393aeb8ee8d6-etc-sysctl-d\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9341beac-d749-44e8-91dc-37fc304f9193-run-ovn\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.838812 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.837760 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:38.839443 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.837837 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.337807101 +0000 UTC m=+3.116334470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:38.839443 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.837827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-serviceca\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.839443 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.838344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49194680-201d-4776-a235-393aeb8ee8d6-tmp\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.839443 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.838413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49194680-201d-4776-a235-393aeb8ee8d6-etc-tuned\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.839443 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.838500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9341beac-d749-44e8-91dc-37fc304f9193-ovn-node-metrics-cert\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.839443 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.838829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16-agent-certs\") pod \"konnectivity-agent-bz9w8\" (UID: \"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16\") " pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:38.856928 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.856889 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:38.857045 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.856934 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:38.857045 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.856949 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:38.857045 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:38.857017 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.356998351 +0000 UTC m=+3.135525721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:38.858621 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.858596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl5cm\" (UniqueName: \"kubernetes.io/projected/7a37b93b-7bef-46f7-b4e9-13cb3520156c-kube-api-access-dl5cm\") pod \"node-resolver-l58z4\" (UID: \"7a37b93b-7bef-46f7-b4e9-13cb3520156c\") " pod="openshift-dns/node-resolver-l58z4" May 27 19:32:38.858828 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.858805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtm9\" (UniqueName: \"kubernetes.io/projected/be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa-kube-api-access-sjtm9\") pod \"multus-additional-cni-plugins-7hj5r\" (UID: \"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa\") " pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:38.858897 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.858870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbjx\" (UniqueName: \"kubernetes.io/projected/ad9e6780-697b-406e-bf58-b55ed5712173-kube-api-access-8mbjx\") pod \"iptables-alerter-mqgpn\" (UID: \"ad9e6780-697b-406e-bf58-b55ed5712173\") " pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:38.859744 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.859723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs9st\" (UniqueName: \"kubernetes.io/projected/dae4d9c2-097d-4e21-b58f-9d8130e7cf79-kube-api-access-gs9st\") pod \"aws-ebs-csi-driver-node-46g4w\" (UID: \"dae4d9c2-097d-4e21-b58f-9d8130e7cf79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:38.860246 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.860211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndz6\" (UniqueName: \"kubernetes.io/projected/94c97bd7-b8dc-4298-b4a5-aad6d5d2122b-kube-api-access-8ndz6\") pod \"node-ca-4hsf5\" (UID: \"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b\") " pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:38.860643 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.860600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54sr\" (UniqueName: \"kubernetes.io/projected/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-kube-api-access-d54sr\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:38.860734 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.860680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nrt\" (UniqueName: \"kubernetes.io/projected/9341beac-d749-44e8-91dc-37fc304f9193-kube-api-access-p7nrt\") pod \"ovnkube-node-zpjx2\" (UID: \"9341beac-d749-44e8-91dc-37fc304f9193\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:38.860789 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.860764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9brn5\" (UniqueName: \"kubernetes.io/projected/49194680-201d-4776-a235-393aeb8ee8d6-kube-api-access-9brn5\") pod \"tuned-zn27q\" (UID: \"49194680-201d-4776-a235-393aeb8ee8d6\") " pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:38.937182 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937102 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-system-cni-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937182 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937133 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-cnibin\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937183 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-k8s-cni-cncf-io\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937205 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-netns\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937222 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-multus-certs\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937246 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-daemon-config\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937272 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-k8s-cni-cncf-io\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-multus-certs\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-run-netns\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937329 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-conf-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937355 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-cni-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-system-cni-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-conf-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937417 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-cni-multus\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-cni-multus\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-kubelet\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937502 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/076cfd02-ac02-43cf-bc22-6548333bd8d6-cni-binary-copy\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-cni-dir\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937555 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-etc-kubernetes\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-kubelet\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937594 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-socket-dir-parent\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937610 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-cnibin\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937634 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-etc-kubernetes\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937670 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvqc\" (UniqueName: \"kubernetes.io/projected/076cfd02-ac02-43cf-bc22-6548333bd8d6-kube-api-access-4tvqc\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937679 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-socket-dir-parent\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937796 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-os-release\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/076cfd02-ac02-43cf-bc22-6548333bd8d6-multus-daemon-config\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.937819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937822 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-hostroot\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.938645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937856 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-cni-bin\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.938645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-hostroot\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.938645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937957 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-os-release\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.938645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.937958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076cfd02-ac02-43cf-bc22-6548333bd8d6-host-var-lib-cni-bin\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.938645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.938015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/076cfd02-ac02-43cf-bc22-6548333bd8d6-cni-binary-copy\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:38.946501 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:38.946480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvqc\" (UniqueName: \"kubernetes.io/projected/076cfd02-ac02-43cf-bc22-6548333bd8d6-kube-api-access-4tvqc\") pod \"multus-t6cnk\" (UID: \"076cfd02-ac02-43cf-bc22-6548333bd8d6\") " pod="openshift-multus/multus-t6cnk" May 27 19:32:39.014984 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.014952 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:32:39.022780 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.022759 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" May 27 19:32:39.035448 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.035417 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqgpn" May 27 19:32:39.040151 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.040130 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bz9w8" May 27 19:32:39.047739 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.047720 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" May 27 19:32:39.054292 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.054275 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zn27q" May 27 19:32:39.060854 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.060835 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l58z4" May 27 19:32:39.068459 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.068439 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4hsf5" May 27 19:32:39.074011 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.073993 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6cnk" May 27 19:32:39.340027 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.339941 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:39.340180 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.340062 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:39.340180 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.340124 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:32:40.340104207 +0000 UTC m=+4.118631558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:39.441206 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.441146 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:39.441344 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.441293 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:39.441344 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.441309 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:39.441344 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.441318 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:39.441467 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.441371 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:32:40.441355739 +0000 UTC m=+4.219883088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:39.454428 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.454393 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe11dcc3_bbfb_49aa_82d8_a45eaf2da7fa.slice/crio-b569375ac916162cb936712d147d2d65eefeafe2e1cb0cb71312cdcb85242306 WatchSource:0}: Error finding container b569375ac916162cb936712d147d2d65eefeafe2e1cb0cb71312cdcb85242306: Status 404 returned error can't find the container with id b569375ac916162cb936712d147d2d65eefeafe2e1cb0cb71312cdcb85242306 May 27 19:32:39.455047 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.454991 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9341beac_d749_44e8_91dc_37fc304f9193.slice/crio-45f96fb2788a45dfb981ce0230bd09c81a80507f678aea4d63a512e7b8c2da8a WatchSource:0}: Error finding container 45f96fb2788a45dfb981ce0230bd09c81a80507f678aea4d63a512e7b8c2da8a: Status 404 returned error can't find the container with id 45f96fb2788a45dfb981ce0230bd09c81a80507f678aea4d63a512e7b8c2da8a May 27 19:32:39.459865 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.459843 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49194680_201d_4776_a235_393aeb8ee8d6.slice/crio-8f0f86574d949a58c440155475a52b050f56d151921efd5725caf4b9fe919b6d WatchSource:0}: Error finding container 8f0f86574d949a58c440155475a52b050f56d151921efd5725caf4b9fe919b6d: Status 404 returned error can't find the container with id 8f0f86574d949a58c440155475a52b050f56d151921efd5725caf4b9fe919b6d May 27 19:32:39.461052 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.461031 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a37b93b_7bef_46f7_b4e9_13cb3520156c.slice/crio-d6971b5b25960a831dac74a98fee01a42195ada70164ef21e7502528dc93b6a5 WatchSource:0}: Error finding container d6971b5b25960a831dac74a98fee01a42195ada70164ef21e7502528dc93b6a5: Status 404 returned error can't find the container with id d6971b5b25960a831dac74a98fee01a42195ada70164ef21e7502528dc93b6a5 May 27 19:32:39.462918 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.462637 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c97bd7_b8dc_4298_b4a5_aad6d5d2122b.slice/crio-839f188954afe36afcdf48a709127ecee7c4cee179ce4c1526c950d1ef26bb80 WatchSource:0}: Error finding container 839f188954afe36afcdf48a709127ecee7c4cee179ce4c1526c950d1ef26bb80: Status 404 returned error can't find the container with id 839f188954afe36afcdf48a709127ecee7c4cee179ce4c1526c950d1ef26bb80 May 27 19:32:39.466477 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.466460 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae4d9c2_097d_4e21_b58f_9d8130e7cf79.slice/crio-78b8be8e0621df975dce93ae71dd61a61392a1f19f809b200d04a6763067f156 WatchSource:0}: Error finding container 78b8be8e0621df975dce93ae71dd61a61392a1f19f809b200d04a6763067f156: Status 404 returned error can't find the container with id 78b8be8e0621df975dce93ae71dd61a61392a1f19f809b200d04a6763067f156 May 27 19:32:39.467656 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.467511 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076cfd02_ac02_43cf_bc22_6548333bd8d6.slice/crio-f8a7bd55ca3783d784e89c6982bcf0d1da0a67ace7419cbde4709f8ea7c2eb64 WatchSource:0}: Error finding container f8a7bd55ca3783d784e89c6982bcf0d1da0a67ace7419cbde4709f8ea7c2eb64: Status 404 returned error can't find the container with id f8a7bd55ca3783d784e89c6982bcf0d1da0a67ace7419cbde4709f8ea7c2eb64 May 27 19:32:39.468414 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.468348 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9e6780_697b_406e_bf58_b55ed5712173.slice/crio-28375cd7f7c4412f3a1d43eeeefdf5ad946fbe7d8b16b63834d7287ca2324993 WatchSource:0}: Error finding container 28375cd7f7c4412f3a1d43eeeefdf5ad946fbe7d8b16b63834d7287ca2324993: Status 404 returned error can't find the container with id 28375cd7f7c4412f3a1d43eeeefdf5ad946fbe7d8b16b63834d7287ca2324993 May 27 19:32:39.470010 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:32:39.469876 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d0dee9_85a6_4d5a_bf6d_3d575a8cea16.slice/crio-902a91632dd134046b12c5ddb2a54030f9fe7454c731c3adcf8d81fa0e09c531 WatchSource:0}: Error finding container 902a91632dd134046b12c5ddb2a54030f9fe7454c731c3adcf8d81fa0e09c531: Status 404 returned error can't find the container with id 902a91632dd134046b12c5ddb2a54030f9fe7454c731c3adcf8d81fa0e09c531 May 27 19:32:39.761417 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.761231 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 19:27:37 +0000 UTC" deadline="2028-02-24 22:58:37.644857364 +0000 UTC" May 27 19:32:39.761417 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.761416 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15315h25m57.883444646s" May 27 19:32:39.849329 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.849293 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:39.849491 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:39.849458 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:39.857415 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.857388 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bz9w8" event={"ID":"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16","Type":"ContainerStarted","Data":"902a91632dd134046b12c5ddb2a54030f9fe7454c731c3adcf8d81fa0e09c531"} May 27 19:32:39.859202 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.859175 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6cnk" event={"ID":"076cfd02-ac02-43cf-bc22-6548333bd8d6","Type":"ContainerStarted","Data":"f8a7bd55ca3783d784e89c6982bcf0d1da0a67ace7419cbde4709f8ea7c2eb64"} May 27 19:32:39.860680 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.860653 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l58z4" event={"ID":"7a37b93b-7bef-46f7-b4e9-13cb3520156c","Type":"ContainerStarted","Data":"d6971b5b25960a831dac74a98fee01a42195ada70164ef21e7502528dc93b6a5"} May 27 19:32:39.861735 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.861711 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zn27q" event={"ID":"49194680-201d-4776-a235-393aeb8ee8d6","Type":"ContainerStarted","Data":"8f0f86574d949a58c440155475a52b050f56d151921efd5725caf4b9fe919b6d"} May 27 19:32:39.862897 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.862875 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"45f96fb2788a45dfb981ce0230bd09c81a80507f678aea4d63a512e7b8c2da8a"} May 27 19:32:39.864893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.864858 2565 generic.go:358] "Generic (PLEG): container finished" podID="ba4e04f982c43cab08db5ae0812c9c68" containerID="9c895dff40530b714d5e7819e886357453116d911b0d5dc261b0a2492b0c0159" exitCode=0 May 27 19:32:39.864893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.864953 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" event={"ID":"ba4e04f982c43cab08db5ae0812c9c68","Type":"ContainerDied","Data":"9c895dff40530b714d5e7819e886357453116d911b0d5dc261b0a2492b0c0159"} May 27 19:32:39.866830 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.866807 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" event={"ID":"0364653ed866562d9f25e010755536fc","Type":"ContainerStarted","Data":"added4d2d45b8a14d35391906ca218eef1bb5a7f95a4ff79ce4d31d10c5271af"} May 27 19:32:39.868755 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.868699 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqgpn" event={"ID":"ad9e6780-697b-406e-bf58-b55ed5712173","Type":"ContainerStarted","Data":"28375cd7f7c4412f3a1d43eeeefdf5ad946fbe7d8b16b63834d7287ca2324993"} May 27 19:32:39.870869 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.870840 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" event={"ID":"dae4d9c2-097d-4e21-b58f-9d8130e7cf79","Type":"ContainerStarted","Data":"78b8be8e0621df975dce93ae71dd61a61392a1f19f809b200d04a6763067f156"} May 27 19:32:39.872105 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.872060 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4hsf5" event={"ID":"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b","Type":"ContainerStarted","Data":"839f188954afe36afcdf48a709127ecee7c4cee179ce4c1526c950d1ef26bb80"} May 27 19:32:39.874121 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:39.874094 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerStarted","Data":"b569375ac916162cb936712d147d2d65eefeafe2e1cb0cb71312cdcb85242306"} May 27 19:32:40.350331 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:40.350247 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:40.350498 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.350422 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:40.350498 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.350489 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:32:42.350468651 +0000 UTC m=+6.128996006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:40.450853 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:40.450818 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:40.451091 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.451022 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:40.451091 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.451041 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:40.451091 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.451053 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:40.451255 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.451109 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:32:42.451088983 +0000 UTC m=+6.229616345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:40.851074 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:40.850561 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:40.851074 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:40.850691 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:40.908184 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:40.908151 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" event={"ID":"ba4e04f982c43cab08db5ae0812c9c68","Type":"ContainerStarted","Data":"b28d51303eaadae8a45939b05e7871001192c02895abf033cfb664140b0b34f0"} May 27 19:32:40.924355 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:40.924295 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-76.ec2.internal" podStartSLOduration=2.92427808 podStartE2EDuration="2.92427808s" podCreationTimestamp="2026-05-27 19:32:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:32:39.908939102 +0000 UTC m=+3.687466476" watchObservedRunningTime="2026-05-27 19:32:40.92427808 +0000 UTC m=+4.702805661" May 27 19:32:40.924613 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:40.924577 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-76.ec2.internal" podStartSLOduration=2.924557544 podStartE2EDuration="2.924557544s" podCreationTimestamp="2026-05-27 19:32:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:32:40.924097757 +0000 UTC m=+4.702625133" watchObservedRunningTime="2026-05-27 19:32:40.924557544 +0000 UTC m=+4.703084919" May 27 19:32:41.849835 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:41.849800 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:41.850035 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:41.849963 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:42.370359 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:42.369750 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:42.370359 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.369960 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:42.370359 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.370029 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:32:46.370009795 +0000 UTC m=+10.148537157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:42.471315 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:42.470682 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:42.471315 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.470845 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:42.471315 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.470863 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:42.471315 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.470875 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:42.471315 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.470946 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:32:46.470927048 +0000 UTC m=+10.249454403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:42.850489 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:42.849989 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:42.850489 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:42.850109 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:43.849457 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:43.849387 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:43.849947 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:43.849524 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:44.849723 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:44.849690 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:44.850201 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:44.849829 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:45.849882 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:45.849777 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:45.850445 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:45.849938 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:46.406113 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:46.405611 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:46.406113 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.405889 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:46.406113 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.405967 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:32:54.405946749 +0000 UTC m=+18.184474104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:46.506065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:46.506029 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:46.506255 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.506184 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:46.506255 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.506201 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:46.506255 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.506214 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:46.506408 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.506271 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:32:54.506252824 +0000 UTC m=+18.284780178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:46.852983 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:46.852284 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:46.852983 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:46.852945 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:47.850017 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:47.849982 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:47.850165 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:47.850129 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:48.850033 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:48.850002 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:48.850485 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:48.850127 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:49.849956 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:49.849868 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:49.850094 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:49.850002 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:50.849301 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:50.849265 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:50.849515 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:50.849396 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:51.849404 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:51.849366 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:51.849792 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:51.849500 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:52.849944 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:52.849893 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:52.850351 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:52.850030 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:53.849463 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:53.849433 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:53.849722 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:53.849559 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:54.461998 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:54.461951 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:54.462400 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.462079 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:54.462400 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.462142 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:33:10.462121052 +0000 UTC m=+34.240648403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:54.562706 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:54.562670 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:54.562892 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.562826 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:54.562892 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.562842 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:54.562892 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.562851 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:54.563027 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.562920 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:33:10.562886541 +0000 UTC m=+34.341413911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:54.849401 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:54.849322 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:54.849565 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:54.849452 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:55.849868 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:55.849835 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:55.850296 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:55.849966 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:56.850106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:56.850071 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:56.850548 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:56.850180 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:57.849551 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:57.849512 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:57.849697 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:57.849626 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:58.849895 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.849643 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:32:58.850478 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:58.850036 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:32:58.947258 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.947216 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bz9w8" event={"ID":"d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16","Type":"ContainerStarted","Data":"b5e3ac3feb426d38554b96efcd34c5691ddc80a2c1481fce4a3ef64893feedde"} May 27 19:32:58.948640 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.948612 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6cnk" event={"ID":"076cfd02-ac02-43cf-bc22-6548333bd8d6","Type":"ContainerStarted","Data":"4ca4fb54c2718f35d8fac6887a8b66741ccae5e0500e7f9b267a4a1427102016"} May 27 19:32:58.950141 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.950113 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l58z4" event={"ID":"7a37b93b-7bef-46f7-b4e9-13cb3520156c","Type":"ContainerStarted","Data":"258b5bf8ba918cd344546f98d8d63d621eb9425871edd3273d70e958da8c8ad1"} May 27 19:32:58.951578 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.951551 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zn27q" event={"ID":"49194680-201d-4776-a235-393aeb8ee8d6","Type":"ContainerStarted","Data":"0f5945fad12978cad7c52a414aeeaf12e3395b98ce3c582e4a3ff456e98284d9"} May 27 19:32:58.954536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.954469 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"9250195de5ef6d9a198822d02b531d3bfcc1e6557e9d88ddaa8e1a7fbadad754"} May 27 19:32:58.954536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.954498 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"2c125639cc22fa58a69fbae1a5c5dd028ad464d2fc978b77cc6c0531aa0265f9"} May 27 19:32:58.954536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.954511 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"6acf30633c982cba69f14d76ef83eecd967b2e2e7bf083365b193acf98badf5b"} May 27 19:32:58.954536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.954522 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"afc300219613ecfe79bf73219d73829fdd410e6468f2fa8189fa355d2e96475c"} May 27 19:32:58.954536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.954534 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"cb123956a414b1902caecfa00c31a9ac590928c975838534536b58747f450d24"} May 27 19:32:58.954850 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.954547 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"bea872b1575b2ff968aa7f8056b8274ba9c547df7990ffc7404e43ed96063a4c"} May 27 19:32:58.955775 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.955750 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" event={"ID":"dae4d9c2-097d-4e21-b58f-9d8130e7cf79","Type":"ContainerStarted","Data":"8c452c05784b7b74977342daa5c69971346354b8fc9c4e68c642c3c1356cb15d"} May 27 19:32:58.957062 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.957041 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4hsf5" event={"ID":"94c97bd7-b8dc-4298-b4a5-aad6d5d2122b","Type":"ContainerStarted","Data":"bcbbde07aa50bfd26fcfb415af6ac2af194ab96062c7a9fda383ed6e5449245a"} May 27 19:32:58.958500 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.958477 2565 generic.go:358] "Generic (PLEG): container finished" podID="be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa" containerID="89bed8ede7e583f807b1ea1e04121592a0a48df86e696b34499f01463c1a11ff" exitCode=0 May 27 19:32:58.958576 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.958509 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerDied","Data":"89bed8ede7e583f807b1ea1e04121592a0a48df86e696b34499f01463c1a11ff"} May 27 19:32:58.964554 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.964478 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bz9w8" podStartSLOduration=3.465582306 podStartE2EDuration="21.964464772s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.471299291 +0000 UTC m=+3.249826640" lastFinishedPulling="2026-05-27 19:32:57.970181751 +0000 UTC m=+21.748709106" observedRunningTime="2026-05-27 19:32:58.96377944 +0000 UTC m=+22.742306815" watchObservedRunningTime="2026-05-27 19:32:58.964464772 +0000 UTC m=+22.742992148" May 27 19:32:58.980674 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.980093 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zn27q" podStartSLOduration=3.46979597 podStartE2EDuration="21.980082728s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.462512251 +0000 UTC m=+3.241039600" lastFinishedPulling="2026-05-27 19:32:57.972799007 +0000 UTC m=+21.751326358" observedRunningTime="2026-05-27 19:32:58.980082642 +0000 UTC m=+22.758610014" watchObservedRunningTime="2026-05-27 19:32:58.980082728 +0000 UTC m=+22.758610101" May 27 19:32:58.996391 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:58.996358 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l58z4" podStartSLOduration=3.49184286 podStartE2EDuration="21.996345013s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.465319955 +0000 UTC m=+3.243847307" lastFinishedPulling="2026-05-27 19:32:57.96982209 +0000 UTC m=+21.748349460" observedRunningTime="2026-05-27 19:32:58.996077526 +0000 UTC m=+22.774604901" watchObservedRunningTime="2026-05-27 19:32:58.996345013 +0000 UTC m=+22.774872388" May 27 19:32:59.016988 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.016945 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t6cnk" podStartSLOduration=3.514517779 podStartE2EDuration="22.016931802s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.469259743 +0000 UTC m=+3.247787096" lastFinishedPulling="2026-05-27 19:32:57.971673762 +0000 UTC m=+21.750201119" observedRunningTime="2026-05-27 19:32:59.016507757 +0000 UTC m=+22.795035129" watchObservedRunningTime="2026-05-27 19:32:59.016931802 +0000 UTC m=+22.795459176" May 27 19:32:59.052447 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.052406 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4hsf5" podStartSLOduration=11.884179072 podStartE2EDuration="22.052395735s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.465842207 +0000 UTC m=+3.244369565" lastFinishedPulling="2026-05-27 19:32:49.634058863 +0000 UTC m=+13.412586228" observedRunningTime="2026-05-27 19:32:59.052176174 +0000 UTC m=+22.830703547" watchObservedRunningTime="2026-05-27 19:32:59.052395735 +0000 UTC m=+22.830923107" May 27 19:32:59.478075 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.478051 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 19:32:59.792258 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.792169 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T19:32:59.478071114Z","UUID":"516b6187-2b02-4690-81e7-8eee28f3d3ec","Handler":null,"Name":"","Endpoint":""} May 27 19:32:59.794988 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.794965 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 19:32:59.795122 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.794995 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 19:32:59.849876 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.849855 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:32:59.850003 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:32:59.849968 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:32:59.962143 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.962108 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqgpn" event={"ID":"ad9e6780-697b-406e-bf58-b55ed5712173","Type":"ContainerStarted","Data":"54f2b255916fe24d9571492cbef2d0a789d6f9df90bfa5bc74be958c3f9a996d"} May 27 19:32:59.963914 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.963867 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" event={"ID":"dae4d9c2-097d-4e21-b58f-9d8130e7cf79","Type":"ContainerStarted","Data":"c36643f6c1cce8e8868955cac944d305d357a524cdc74d2ed9f41e262814c3e5"} May 27 19:32:59.980286 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:32:59.980247 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mqgpn" podStartSLOduration=5.480402098 podStartE2EDuration="23.980235498s" podCreationTimestamp="2026-05-27 19:32:36 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.470306674 +0000 UTC m=+3.248834027" lastFinishedPulling="2026-05-27 19:32:57.970140078 +0000 UTC m=+21.748667427" observedRunningTime="2026-05-27 19:32:59.979806616 +0000 UTC m=+23.758334002" watchObservedRunningTime="2026-05-27 19:32:59.980235498 +0000 UTC m=+23.758762870" May 27 19:33:00.850140 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:00.850109 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:00.850617 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:00.850225 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:00.968053 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:00.968022 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" event={"ID":"dae4d9c2-097d-4e21-b58f-9d8130e7cf79","Type":"ContainerStarted","Data":"ca7d4552f80eaf46e41a31b1269a91890bb70ccea27cc961e244c3dce7c85bab"} May 27 19:33:00.971418 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:00.971369 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"c6cb3ea4fcee706626597325c07ed7ea7d90dbc00e8896612d905d1398581eaa"} May 27 19:33:00.987912 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:00.987856 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46g4w" podStartSLOduration=3.189121963 podStartE2EDuration="23.987844477s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.468078757 +0000 UTC m=+3.246606107" lastFinishedPulling="2026-05-27 19:33:00.26680127 +0000 UTC m=+24.045328621" observedRunningTime="2026-05-27 19:33:00.987564945 +0000 UTC m=+24.766092318" watchObservedRunningTime="2026-05-27 19:33:00.987844477 +0000 UTC m=+24.766371880" May 27 19:33:01.849396 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:01.849363 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:01.849560 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:01.849455 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:02.850147 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:02.849964 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:02.850555 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:02.850225 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:02.892811 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:02.892786 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bz9w8" May 27 19:33:02.893422 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:02.893404 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bz9w8" May 27 19:33:03.850079 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:03.850041 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:03.850266 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:03.850173 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:03.979351 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:03.979311 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" event={"ID":"9341beac-d749-44e8-91dc-37fc304f9193","Type":"ContainerStarted","Data":"33238d2f9e05c3aaac4da1a627a45f25cee69cbad4cadc5b198d57f7b94c2e4c"} May 27 19:33:03.979642 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:03.979618 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:33:03.979775 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:03.979651 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:33:03.995959 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:03.995935 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:33:04.012669 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.012614 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" podStartSLOduration=9.176921407 podStartE2EDuration="28.012594569s" podCreationTimestamp="2026-05-27 19:32:36 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.456891714 +0000 UTC m=+3.235419067" lastFinishedPulling="2026-05-27 19:32:58.292564875 +0000 UTC m=+22.071092229" observedRunningTime="2026-05-27 19:33:04.012030904 +0000 UTC m=+27.790558277" watchObservedRunningTime="2026-05-27 19:33:04.012594569 +0000 UTC m=+27.791121940" May 27 19:33:04.849962 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.849697 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:04.850130 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:04.850067 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:04.981596 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.981553 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:33:04.992163 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.991838 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bz9w8" May 27 19:33:04.992163 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.991963 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 19:33:04.992635 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.992603 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bz9w8" May 27 19:33:04.997998 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:04.997968 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:33:05.850113 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:05.850075 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:05.850297 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:05.850223 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:06.850531 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:06.850506 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:06.850925 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:06.850586 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:06.986126 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:06.986094 2565 generic.go:358] "Generic (PLEG): container finished" podID="be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa" containerID="17efb6aaeb87f7866c313945bca3018791012fc28ff3393b872498c7d3d8ebe2" exitCode=0 May 27 19:33:06.986277 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:06.986189 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerDied","Data":"17efb6aaeb87f7866c313945bca3018791012fc28ff3393b872498c7d3d8ebe2"} May 27 19:33:07.849643 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:07.849606 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:07.849816 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:07.849755 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:08.849158 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:08.849125 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:08.849501 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:08.849224 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:08.991531 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:08.991502 2565 generic.go:358] "Generic (PLEG): container finished" podID="be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa" containerID="5154cfbd4271072f234c6fb1839d097e937565649491ec2f163f86cfc76cfbce" exitCode=0 May 27 19:33:08.991674 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:08.991541 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerDied","Data":"5154cfbd4271072f234c6fb1839d097e937565649491ec2f163f86cfc76cfbce"} May 27 19:33:09.849302 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:09.849275 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:09.849661 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:09.849377 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:10.198651 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.198622 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ssjlj"] May 27 19:33:10.198778 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.198745 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:10.198894 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.198871 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:10.201553 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.201529 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dcwc"] May 27 19:33:10.201662 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.201621 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:10.201732 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.201712 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:10.478926 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.478707 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:10.479116 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.478844 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:33:10.479116 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.479000 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs podName:e4efbc00-a9d7-401c-9c58-71101a6cd3aa nodeName:}" failed. No retries permitted until 2026-05-27 19:33:42.478980103 +0000 UTC m=+66.257507467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs") pod "network-metrics-daemon-ssjlj" (UID: "e4efbc00-a9d7-401c-9c58-71101a6cd3aa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:33:10.579317 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.579283 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:10.579510 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.579486 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:33:10.579573 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.579518 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:33:10.579573 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.579533 2565 projected.go:194] Error preparing data for projected volume kube-api-access-bq2mg for pod openshift-network-diagnostics/network-check-target-4dcwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:33:10.579676 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:10.579603 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg podName:2baecdb8-6eb5-4fa4-80ef-ed27f262f6de nodeName:}" failed. No retries permitted until 2026-05-27 19:33:42.579582772 +0000 UTC m=+66.358110125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bq2mg" (UniqueName: "kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg") pod "network-check-target-4dcwc" (UID: "2baecdb8-6eb5-4fa4-80ef-ed27f262f6de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:33:10.997117 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.997083 2565 generic.go:358] "Generic (PLEG): container finished" podID="be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa" containerID="1b3e53f418cc5a32700e53b06643b6a29fe81a22dc12986edd211928c798912a" exitCode=0 May 27 19:33:10.997549 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:10.997122 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerDied","Data":"1b3e53f418cc5a32700e53b06643b6a29fe81a22dc12986edd211928c798912a"} May 27 19:33:11.849261 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:11.849221 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:11.849443 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:11.849334 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:11.849443 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:11.849237 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:11.849536 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:11.849468 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:13.849860 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:13.849785 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:13.850379 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:13.849785 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:13.850379 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:13.849920 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dcwc" podUID="2baecdb8-6eb5-4fa4-80ef-ed27f262f6de" May 27 19:33:13.850379 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:13.850024 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssjlj" podUID="e4efbc00-a9d7-401c-9c58-71101a6cd3aa" May 27 19:33:13.998635 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:13.998607 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-76.ec2.internal" event="NodeReady" May 27 19:33:13.998799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:13.998748 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 19:33:14.047040 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.047012 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-258f6"] May 27 19:33:14.059849 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.059824 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6lhx9"] May 27 19:33:14.060030 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.060003 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-258f6" May 27 19:33:14.063507 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.063149 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 19:33:14.063507 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.063180 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 19:33:14.063507 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.063400 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hjmsq\"" May 27 19:33:14.067444 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.067420 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-258f6"] May 27 19:33:14.067444 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.067446 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lhx9"] May 27 19:33:14.067624 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.067591 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.070201 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.070045 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 19:33:14.070201 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.070063 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 19:33:14.070201 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.070184 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7w8r9\"" May 27 19:33:14.070428 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.070300 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 19:33:14.207386 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.207353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69741760-2182-4add-b5a5-e22b368f39c9-config-volume\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.207550 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.207394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69741760-2182-4add-b5a5-e22b368f39c9-tmp-dir\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.207550 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.207426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsj2\" (UniqueName: \"kubernetes.io/projected/69741760-2182-4add-b5a5-e22b368f39c9-kube-api-access-7hsj2\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.207550 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.207450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69741760-2182-4add-b5a5-e22b368f39c9-metrics-tls\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.207550 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.207473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4de2f077-1aea-4595-b0bb-b6ed11e753a8-cert\") pod \"ingress-canary-6lhx9\" (UID: \"4de2f077-1aea-4595-b0bb-b6ed11e753a8\") " pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.207550 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.207513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmd5\" (UniqueName: \"kubernetes.io/projected/4de2f077-1aea-4595-b0bb-b6ed11e753a8-kube-api-access-2rmd5\") pod \"ingress-canary-6lhx9\" (UID: \"4de2f077-1aea-4595-b0bb-b6ed11e753a8\") " pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.308729 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.308699 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69741760-2182-4add-b5a5-e22b368f39c9-config-volume\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.308729 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.308731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69741760-2182-4add-b5a5-e22b368f39c9-tmp-dir\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.308972 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.308818 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsj2\" (UniqueName: \"kubernetes.io/projected/69741760-2182-4add-b5a5-e22b368f39c9-kube-api-access-7hsj2\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.308972 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.308857 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69741760-2182-4add-b5a5-e22b368f39c9-metrics-tls\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.308972 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.308955 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4de2f077-1aea-4595-b0bb-b6ed11e753a8-cert\") pod \"ingress-canary-6lhx9\" (UID: \"4de2f077-1aea-4595-b0bb-b6ed11e753a8\") " pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.309122 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.309033 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmd5\" (UniqueName: \"kubernetes.io/projected/4de2f077-1aea-4595-b0bb-b6ed11e753a8-kube-api-access-2rmd5\") pod \"ingress-canary-6lhx9\" (UID: \"4de2f077-1aea-4595-b0bb-b6ed11e753a8\") " pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.309212 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.309190 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69741760-2182-4add-b5a5-e22b368f39c9-tmp-dir\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.309355 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.309336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69741760-2182-4add-b5a5-e22b368f39c9-config-volume\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.313394 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.313369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69741760-2182-4add-b5a5-e22b368f39c9-metrics-tls\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.313493 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.313404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4de2f077-1aea-4595-b0bb-b6ed11e753a8-cert\") pod \"ingress-canary-6lhx9\" (UID: \"4de2f077-1aea-4595-b0bb-b6ed11e753a8\") " pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.317429 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.317372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmd5\" (UniqueName: \"kubernetes.io/projected/4de2f077-1aea-4595-b0bb-b6ed11e753a8-kube-api-access-2rmd5\") pod \"ingress-canary-6lhx9\" (UID: \"4de2f077-1aea-4595-b0bb-b6ed11e753a8\") " pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.317548 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.317446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsj2\" (UniqueName: \"kubernetes.io/projected/69741760-2182-4add-b5a5-e22b368f39c9-kube-api-access-7hsj2\") pod \"dns-default-258f6\" (UID: \"69741760-2182-4add-b5a5-e22b368f39c9\") " pod="openshift-dns/dns-default-258f6" May 27 19:33:14.371446 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.371419 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-258f6" May 27 19:33:14.378179 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.378158 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lhx9" May 27 19:33:14.548346 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.548056 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-258f6"] May 27 19:33:14.549060 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:14.548967 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lhx9"] May 27 19:33:14.551684 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:14.551657 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69741760_2182_4add_b5a5_e22b368f39c9.slice/crio-eb2cd562ff2f1a00a2d99845b00c261a06390fec79184b9624ca1a124522cf13 WatchSource:0}: Error finding container eb2cd562ff2f1a00a2d99845b00c261a06390fec79184b9624ca1a124522cf13: Status 404 returned error can't find the container with id eb2cd562ff2f1a00a2d99845b00c261a06390fec79184b9624ca1a124522cf13 May 27 19:33:14.551890 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:14.551867 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de2f077_1aea_4595_b0bb_b6ed11e753a8.slice/crio-0dd60f42d021aab10f964233b29b359871c656df2e150bcd9356ee9a586f59b5 WatchSource:0}: Error finding container 0dd60f42d021aab10f964233b29b359871c656df2e150bcd9356ee9a586f59b5: Status 404 returned error can't find the container with id 0dd60f42d021aab10f964233b29b359871c656df2e150bcd9356ee9a586f59b5 May 27 19:33:15.005283 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.005233 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-258f6" event={"ID":"69741760-2182-4add-b5a5-e22b368f39c9","Type":"ContainerStarted","Data":"eb2cd562ff2f1a00a2d99845b00c261a06390fec79184b9624ca1a124522cf13"} May 27 19:33:15.006363 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.006339 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lhx9" event={"ID":"4de2f077-1aea-4595-b0bb-b6ed11e753a8","Type":"ContainerStarted","Data":"0dd60f42d021aab10f964233b29b359871c656df2e150bcd9356ee9a586f59b5"} May 27 19:33:15.849113 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.849077 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:15.849319 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.849262 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:15.852163 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.852138 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 19:33:15.853389 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.853356 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hg7p\"" May 27 19:33:15.853512 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.853482 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 19:33:15.853610 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.853593 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 19:33:15.853730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:15.853715 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzfh2\"" May 27 19:33:16.412830 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.412796 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2"] May 27 19:33:16.446829 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.446803 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2"] May 27 19:33:16.447005 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.446954 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:16.450306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.450283 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tb5rm\"" May 27 19:33:16.450427 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.450334 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 27 19:33:16.626012 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.625961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4287aacd-dcdc-4412-969d-9cbee10a0cc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-klfw2\" (UID: \"4287aacd-dcdc-4412-969d-9cbee10a0cc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:16.726335 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.726301 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4287aacd-dcdc-4412-969d-9cbee10a0cc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-klfw2\" (UID: \"4287aacd-dcdc-4412-969d-9cbee10a0cc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:16.730519 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.730488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4287aacd-dcdc-4412-969d-9cbee10a0cc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-klfw2\" (UID: \"4287aacd-dcdc-4412-969d-9cbee10a0cc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:16.756606 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.756557 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:16.885502 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.885467 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-6ntxh"] May 27 19:33:16.914431 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.914402 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-6ntxh"] May 27 19:33:16.914578 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.914514 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:16.917608 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.917582 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 19:33:16.917739 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.917705 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 19:33:16.917947 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:16.917928 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-djzll\"" May 27 19:33:17.028333 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.028244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4swm\" (UniqueName: \"kubernetes.io/projected/8e2f3d98-7c67-4cda-984b-9676b7af7d0d-kube-api-access-b4swm\") pod \"downloads-57bd96b888-6ntxh\" (UID: \"8e2f3d98-7c67-4cda-984b-9676b7af7d0d\") " pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:17.128973 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.128933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4swm\" (UniqueName: \"kubernetes.io/projected/8e2f3d98-7c67-4cda-984b-9676b7af7d0d-kube-api-access-b4swm\") pod \"downloads-57bd96b888-6ntxh\" (UID: \"8e2f3d98-7c67-4cda-984b-9676b7af7d0d\") " pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:17.138457 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.138424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4swm\" (UniqueName: \"kubernetes.io/projected/8e2f3d98-7c67-4cda-984b-9676b7af7d0d-kube-api-access-b4swm\") pod \"downloads-57bd96b888-6ntxh\" (UID: \"8e2f3d98-7c67-4cda-984b-9676b7af7d0d\") " pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:17.228476 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.228445 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:17.411875 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.411794 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg"] May 27 19:33:17.431533 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.431506 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg"] May 27 19:33:17.431986 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.431646 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" May 27 19:33:17.434734 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.434712 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 19:33:17.434855 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.434712 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rj46c\"" May 27 19:33:17.434855 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.434713 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 19:33:17.531780 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.531746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8w7w\" (UniqueName: \"kubernetes.io/projected/0838a755-adc0-449e-aa12-f57a27e0b11e-kube-api-access-s8w7w\") pod \"migrator-b985f5d89-knwcg\" (UID: \"0838a755-adc0-449e-aa12-f57a27e0b11e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" May 27 19:33:17.632713 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.632671 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8w7w\" (UniqueName: \"kubernetes.io/projected/0838a755-adc0-449e-aa12-f57a27e0b11e-kube-api-access-s8w7w\") pod \"migrator-b985f5d89-knwcg\" (UID: \"0838a755-adc0-449e-aa12-f57a27e0b11e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" May 27 19:33:17.643081 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.643054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8w7w\" (UniqueName: \"kubernetes.io/projected/0838a755-adc0-449e-aa12-f57a27e0b11e-kube-api-access-s8w7w\") pod \"migrator-b985f5d89-knwcg\" (UID: \"0838a755-adc0-449e-aa12-f57a27e0b11e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" May 27 19:33:17.741569 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:17.741538 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" May 27 19:33:19.040940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:19.040895 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l58z4_7a37b93b-7bef-46f7-b4e9-13cb3520156c/dns-node-resolver/0.log" May 27 19:33:19.357037 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:19.357008 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2"] May 27 19:33:19.360741 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:19.360714 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4287aacd_dcdc_4412_969d_9cbee10a0cc6.slice/crio-659dd47b483796b229daafebb638da3aec7a0c10d491b256accab662ae1e5f66 WatchSource:0}: Error finding container 659dd47b483796b229daafebb638da3aec7a0c10d491b256accab662ae1e5f66: Status 404 returned error can't find the container with id 659dd47b483796b229daafebb638da3aec7a0c10d491b256accab662ae1e5f66 May 27 19:33:19.572276 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:19.572234 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg"] May 27 19:33:19.575480 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:19.575454 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-6ntxh"] May 27 19:33:19.581946 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:19.581918 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0838a755_adc0_449e_aa12_f57a27e0b11e.slice/crio-a682c7a61edc70ca74df420e54f9dbb396b422de8fa18c876ec039a11b067cef WatchSource:0}: Error finding container a682c7a61edc70ca74df420e54f9dbb396b422de8fa18c876ec039a11b067cef: Status 404 returned error can't find the container with id a682c7a61edc70ca74df420e54f9dbb396b422de8fa18c876ec039a11b067cef May 27 19:33:19.582167 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:19.582142 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2f3d98_7c67_4cda_984b_9676b7af7d0d.slice/crio-cac1f45e1593047f67f04f3759969b3fafe5515b6b87659baf9713b46beabdfc WatchSource:0}: Error finding container cac1f45e1593047f67f04f3759969b3fafe5515b6b87659baf9713b46beabdfc: Status 404 returned error can't find the container with id cac1f45e1593047f67f04f3759969b3fafe5515b6b87659baf9713b46beabdfc May 27 19:33:19.640620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:19.640594 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4hsf5_94c97bd7-b8dc-4298-b4a5-aad6d5d2122b/node-ca/0.log" May 27 19:33:20.019392 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.019356 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" event={"ID":"4287aacd-dcdc-4412-969d-9cbee10a0cc6","Type":"ContainerStarted","Data":"659dd47b483796b229daafebb638da3aec7a0c10d491b256accab662ae1e5f66"} May 27 19:33:20.020336 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.020304 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-6ntxh" event={"ID":"8e2f3d98-7c67-4cda-984b-9676b7af7d0d","Type":"ContainerStarted","Data":"cac1f45e1593047f67f04f3759969b3fafe5515b6b87659baf9713b46beabdfc"} May 27 19:33:20.021403 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.021381 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lhx9" event={"ID":"4de2f077-1aea-4595-b0bb-b6ed11e753a8","Type":"ContainerStarted","Data":"36f2571c4ef18197db5a2d97082708118285fae62fc027b2759435662e1c094b"} May 27 19:33:20.022269 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.022241 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" event={"ID":"0838a755-adc0-449e-aa12-f57a27e0b11e","Type":"ContainerStarted","Data":"a682c7a61edc70ca74df420e54f9dbb396b422de8fa18c876ec039a11b067cef"} May 27 19:33:20.023536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.023511 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-258f6" event={"ID":"69741760-2182-4add-b5a5-e22b368f39c9","Type":"ContainerStarted","Data":"9740a7828fb68758e59174e4963dcbe796f4df8f248bcdb67b54fe07697bbb8a"} May 27 19:33:20.023536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.023537 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-258f6" event={"ID":"69741760-2182-4add-b5a5-e22b368f39c9","Type":"ContainerStarted","Data":"65755a3e14c0de5eec09f6ba194f36139d7c3cfca7a56f016f1b152bdd3d7a0a"} May 27 19:33:20.023673 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.023641 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-258f6" May 27 19:33:20.025815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.025792 2565 generic.go:358] "Generic (PLEG): container finished" podID="be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa" containerID="7566730a1e21246c0998a4c29c4da8eae227daf8cf847c5f8009d6cbaf46212f" exitCode=0 May 27 19:33:20.025894 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.025823 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerDied","Data":"7566730a1e21246c0998a4c29c4da8eae227daf8cf847c5f8009d6cbaf46212f"} May 27 19:33:20.063827 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.063578 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6lhx9" podStartSLOduration=1.457716636 podStartE2EDuration="6.063544925s" podCreationTimestamp="2026-05-27 19:33:14 +0000 UTC" firstStartedPulling="2026-05-27 19:33:14.555949186 +0000 UTC m=+38.334476543" lastFinishedPulling="2026-05-27 19:33:19.161777478 +0000 UTC m=+42.940304832" observedRunningTime="2026-05-27 19:33:20.037686713 +0000 UTC m=+43.816214108" watchObservedRunningTime="2026-05-27 19:33:20.063544925 +0000 UTC m=+43.842072298" May 27 19:33:20.079044 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.078983 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-258f6" podStartSLOduration=1.471764936 podStartE2EDuration="6.078965717s" podCreationTimestamp="2026-05-27 19:33:14 +0000 UTC" firstStartedPulling="2026-05-27 19:33:14.554578131 +0000 UTC m=+38.333105483" lastFinishedPulling="2026-05-27 19:33:19.1617789 +0000 UTC m=+42.940306264" observedRunningTime="2026-05-27 19:33:20.078173696 +0000 UTC m=+43.856701071" watchObservedRunningTime="2026-05-27 19:33:20.078965717 +0000 UTC m=+43.857493090" May 27 19:33:20.440764 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:20.440730 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lhx9_4de2f077-1aea-4595-b0bb-b6ed11e753a8/serve-healthcheck-canary/0.log" May 27 19:33:21.031318 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:21.031279 2565 generic.go:358] "Generic (PLEG): container finished" podID="be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa" containerID="20c33c0874a75ab848b950c5ecc009214b213b09b7a95216313b3debf97d0119" exitCode=0 May 27 19:33:21.031487 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:21.031344 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerDied","Data":"20c33c0874a75ab848b950c5ecc009214b213b09b7a95216313b3debf97d0119"} May 27 19:33:22.039094 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.039059 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" event={"ID":"be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa","Type":"ContainerStarted","Data":"898debb742dc7dbcde7c59e16b5c71310a637efb181dc96141d94ccfaf140185"} May 27 19:33:22.040799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.040769 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" event={"ID":"4287aacd-dcdc-4412-969d-9cbee10a0cc6","Type":"ContainerStarted","Data":"d99707ce5cdf2a51b47ad8c0b0f8a3d35fac441d052747cd376a4043a078ea83"} May 27 19:33:22.040957 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.040938 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:22.042554 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.042493 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" event={"ID":"0838a755-adc0-449e-aa12-f57a27e0b11e","Type":"ContainerStarted","Data":"9696b805d26f0fe951969878374d5807ce2e70aa20bbcd033912762d2d15a5d5"} May 27 19:33:22.042554 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.042529 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" event={"ID":"0838a755-adc0-449e-aa12-f57a27e0b11e","Type":"ContainerStarted","Data":"b1168b49218816d606d65d234f62291d2bc8a9b4533fb047867ef82a62ffe2f6"} May 27 19:33:22.046657 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.046637 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" May 27 19:33:22.066101 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.066023 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7hj5r" podStartSLOduration=6.360423534 podStartE2EDuration="46.066011957s" podCreationTimestamp="2026-05-27 19:32:36 +0000 UTC" firstStartedPulling="2026-05-27 19:32:39.456193387 +0000 UTC m=+3.234720740" lastFinishedPulling="2026-05-27 19:33:19.161781801 +0000 UTC m=+42.940309163" observedRunningTime="2026-05-27 19:33:22.063816607 +0000 UTC m=+45.842343989" watchObservedRunningTime="2026-05-27 19:33:22.066011957 +0000 UTC m=+45.844539336" May 27 19:33:22.079801 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.079758 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-klfw2" podStartSLOduration=3.890519152 podStartE2EDuration="6.079743439s" podCreationTimestamp="2026-05-27 19:33:16 +0000 UTC" firstStartedPulling="2026-05-27 19:33:19.363162177 +0000 UTC m=+43.141689527" lastFinishedPulling="2026-05-27 19:33:21.552386458 +0000 UTC m=+45.330913814" observedRunningTime="2026-05-27 19:33:22.079234465 +0000 UTC m=+45.857761829" watchObservedRunningTime="2026-05-27 19:33:22.079743439 +0000 UTC m=+45.858270813" May 27 19:33:22.095759 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.095715 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-knwcg" podStartSLOduration=2.86305132 podStartE2EDuration="5.09570258s" podCreationTimestamp="2026-05-27 19:33:17 +0000 UTC" firstStartedPulling="2026-05-27 19:33:19.584095303 +0000 UTC m=+43.362622654" lastFinishedPulling="2026-05-27 19:33:21.816746557 +0000 UTC m=+45.595273914" observedRunningTime="2026-05-27 19:33:22.095361152 +0000 UTC m=+45.873888523" watchObservedRunningTime="2026-05-27 19:33:22.09570258 +0000 UTC m=+45.874229946" May 27 19:33:22.481126 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.481089 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd"] May 27 19:33:22.496883 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.496857 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd"] May 27 19:33:22.497060 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.497017 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.499578 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.499545 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6h9tb\"" May 27 19:33:22.499698 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.499577 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 27 19:33:22.499698 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.499580 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 19:33:22.500017 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.499995 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 27 19:33:22.500139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.500026 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 19:33:22.500139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.500069 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 19:33:22.673644 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.673608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ccd9\" (UniqueName: \"kubernetes.io/projected/ab3cf7c0-e124-447f-9eeb-277438dc4852-kube-api-access-5ccd9\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.673644 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.673656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3cf7c0-e124-447f-9eeb-277438dc4852-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.673870 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.673696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab3cf7c0-e124-447f-9eeb-277438dc4852-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.673870 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.673756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab3cf7c0-e124-447f-9eeb-277438dc4852-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.774451 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.774367 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ccd9\" (UniqueName: \"kubernetes.io/projected/ab3cf7c0-e124-447f-9eeb-277438dc4852-kube-api-access-5ccd9\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.774451 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.774406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3cf7c0-e124-447f-9eeb-277438dc4852-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.774451 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.774439 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab3cf7c0-e124-447f-9eeb-277438dc4852-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.774716 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.774474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab3cf7c0-e124-447f-9eeb-277438dc4852-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.775211 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.775185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab3cf7c0-e124-447f-9eeb-277438dc4852-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.777259 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.777232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab3cf7c0-e124-447f-9eeb-277438dc4852-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.777490 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.777472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3cf7c0-e124-447f-9eeb-277438dc4852-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.786979 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.786951 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ccd9\" (UniqueName: \"kubernetes.io/projected/ab3cf7c0-e124-447f-9eeb-277438dc4852-kube-api-access-5ccd9\") pod \"prometheus-operator-7779bbdd78-bzcjd\" (UID: \"ab3cf7c0-e124-447f-9eeb-277438dc4852\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.808101 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.808071 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" May 27 19:33:22.946523 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:22.946492 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd"] May 27 19:33:22.966885 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:22.966854 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3cf7c0_e124_447f_9eeb_277438dc4852.slice/crio-b7e5978fd616add7e603cad0a7f12c0d42417d514d768fae0ab639f245e826e4 WatchSource:0}: Error finding container b7e5978fd616add7e603cad0a7f12c0d42417d514d768fae0ab639f245e826e4: Status 404 returned error can't find the container with id b7e5978fd616add7e603cad0a7f12c0d42417d514d768fae0ab639f245e826e4 May 27 19:33:23.046355 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:23.046250 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" event={"ID":"ab3cf7c0-e124-447f-9eeb-277438dc4852","Type":"ContainerStarted","Data":"b7e5978fd616add7e603cad0a7f12c0d42417d514d768fae0ab639f245e826e4"} May 27 19:33:26.059657 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.059617 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" event={"ID":"ab3cf7c0-e124-447f-9eeb-277438dc4852","Type":"ContainerStarted","Data":"8f1187a617eee6c2020e6b3fec517066230f1efeafb4344a4525dc421fd2d49e"} May 27 19:33:26.059657 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.059662 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" event={"ID":"ab3cf7c0-e124-447f-9eeb-277438dc4852","Type":"ContainerStarted","Data":"c219c6f15d1cebc6b4295a4f5a82551bf6153974c5e9bf6a2cf6afa5ae7287d7"} May 27 19:33:26.078458 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.078411 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-bzcjd" podStartSLOduration=2.013609429 podStartE2EDuration="4.07839761s" podCreationTimestamp="2026-05-27 19:33:22 +0000 UTC" firstStartedPulling="2026-05-27 19:33:22.969101807 +0000 UTC m=+46.747629163" lastFinishedPulling="2026-05-27 19:33:25.033889988 +0000 UTC m=+48.812417344" observedRunningTime="2026-05-27 19:33:26.077281787 +0000 UTC m=+49.855809159" watchObservedRunningTime="2026-05-27 19:33:26.07839761 +0000 UTC m=+49.856924981" May 27 19:33:26.426194 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.426113 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gjv27"] May 27 19:33:26.438518 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.438492 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.440522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.440482 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gjv27"] May 27 19:33:26.440918 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.440874 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 19:33:26.441040 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.440919 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jqbp5\"" May 27 19:33:26.441182 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.441169 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 19:33:26.441239 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.441188 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 19:33:26.441287 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.441196 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 19:33:26.544504 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.544473 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b854b4f94-56wzj"] May 27 19:33:26.565344 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.565311 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b854b4f94-56wzj"] May 27 19:33:26.565502 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.565354 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.568484 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.568456 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 19:33:26.568767 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.568745 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 19:33:26.568767 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.568755 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 19:33:26.568954 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.568790 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 19:33:26.568954 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.568745 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 19:33:26.568954 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.568746 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gtrjh\"" May 27 19:33:26.602227 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.602167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsh5t\" (UniqueName: \"kubernetes.io/projected/587775c1-24d5-4668-9a58-dc877febc9c3-kube-api-access-qsh5t\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.602376 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.602243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/587775c1-24d5-4668-9a58-dc877febc9c3-data-volume\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.602376 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.602285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/587775c1-24d5-4668-9a58-dc877febc9c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.602376 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.602312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/587775c1-24d5-4668-9a58-dc877febc9c3-crio-socket\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.602376 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.602334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/587775c1-24d5-4668-9a58-dc877febc9c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.702897 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.702859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-oauth-config\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.703074 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.702931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvq2m\" (UniqueName: \"kubernetes.io/projected/e9c5e6df-d000-4125-8373-c46f8f4d515f-kube-api-access-vvq2m\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.703074 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.702973 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsh5t\" (UniqueName: \"kubernetes.io/projected/587775c1-24d5-4668-9a58-dc877febc9c3-kube-api-access-qsh5t\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703074 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.702994 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/587775c1-24d5-4668-9a58-dc877febc9c3-data-volume\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703074 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-config\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.703266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703151 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/587775c1-24d5-4668-9a58-dc877febc9c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-service-ca\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.703266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703217 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/587775c1-24d5-4668-9a58-dc877febc9c3-crio-socket\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703244 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/587775c1-24d5-4668-9a58-dc877febc9c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703438 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-serving-cert\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.703438 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/587775c1-24d5-4668-9a58-dc877febc9c3-data-volume\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703438 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-oauth-serving-cert\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.703555 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/587775c1-24d5-4668-9a58-dc877febc9c3-crio-socket\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.703728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.703705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/587775c1-24d5-4668-9a58-dc877febc9c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.705919 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.705877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/587775c1-24d5-4668-9a58-dc877febc9c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.715492 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.715472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsh5t\" (UniqueName: \"kubernetes.io/projected/587775c1-24d5-4668-9a58-dc877febc9c3-kube-api-access-qsh5t\") pod \"insights-runtime-extractor-gjv27\" (UID: \"587775c1-24d5-4668-9a58-dc877febc9c3\") " pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.750580 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.750555 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gjv27" May 27 19:33:26.804215 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.804182 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-oauth-serving-cert\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.804992 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.804956 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-oauth-config\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.805103 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.805026 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvq2m\" (UniqueName: \"kubernetes.io/projected/e9c5e6df-d000-4125-8373-c46f8f4d515f-kube-api-access-vvq2m\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.805103 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.805082 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-config\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.805203 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.805127 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-service-ca\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.805203 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.805175 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-serving-cert\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.805605 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.805582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-oauth-serving-cert\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.806300 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.806251 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-service-ca\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.806595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.806555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-config\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.809485 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.809462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-oauth-config\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.809564 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.809489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-serving-cert\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.813989 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.813969 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvq2m\" (UniqueName: \"kubernetes.io/projected/e9c5e6df-d000-4125-8373-c46f8f4d515f-kube-api-access-vvq2m\") pod \"console-6b854b4f94-56wzj\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.875580 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.875545 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:26.894687 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:26.894656 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gjv27"] May 27 19:33:26.908594 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:26.908561 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587775c1_24d5_4668_9a58_dc877febc9c3.slice/crio-28558ec316e8e951a2af3902804c29d069b86b30ccbc97a04366b67ae1f6cfb3 WatchSource:0}: Error finding container 28558ec316e8e951a2af3902804c29d069b86b30ccbc97a04366b67ae1f6cfb3: Status 404 returned error can't find the container with id 28558ec316e8e951a2af3902804c29d069b86b30ccbc97a04366b67ae1f6cfb3 May 27 19:33:27.012477 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.012437 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b854b4f94-56wzj"] May 27 19:33:27.015593 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:27.015564 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c5e6df_d000_4125_8373_c46f8f4d515f.slice/crio-767a8656517e4bc535441822992d02347cb79a7a5aedf0239ad74035556a8ad0 WatchSource:0}: Error finding container 767a8656517e4bc535441822992d02347cb79a7a5aedf0239ad74035556a8ad0: Status 404 returned error can't find the container with id 767a8656517e4bc535441822992d02347cb79a7a5aedf0239ad74035556a8ad0 May 27 19:33:27.064092 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.064057 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjv27" event={"ID":"587775c1-24d5-4668-9a58-dc877febc9c3","Type":"ContainerStarted","Data":"62671765b642a68b4aa65b889256fc06ec843e7b72f2b9597f3009c5bb7646f3"} May 27 19:33:27.064092 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.064098 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjv27" event={"ID":"587775c1-24d5-4668-9a58-dc877febc9c3","Type":"ContainerStarted","Data":"28558ec316e8e951a2af3902804c29d069b86b30ccbc97a04366b67ae1f6cfb3"} May 27 19:33:27.065308 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.065282 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b854b4f94-56wzj" event={"ID":"e9c5e6df-d000-4125-8373-c46f8f4d515f","Type":"ContainerStarted","Data":"767a8656517e4bc535441822992d02347cb79a7a5aedf0239ad74035556a8ad0"} May 27 19:33:27.835296 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.835260 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg"] May 27 19:33:27.838616 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.838557 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:27.841303 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.841278 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 19:33:27.841429 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.841330 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sv8jf\"" May 27 19:33:27.841478 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.841278 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 19:33:27.850272 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.850248 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg"] May 27 19:33:27.863017 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.862993 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h"] May 27 19:33:27.866978 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.866954 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:27.869418 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.869397 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 27 19:33:27.870338 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.869966 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 27 19:33:27.870338 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.870193 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gk7lp\"" May 27 19:33:27.870536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.870520 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 27 19:33:27.879602 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.879580 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h"] May 27 19:33:27.880549 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.880486 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hd2vz"] May 27 19:33:27.884360 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.884340 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:27.886643 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.886623 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 19:33:27.887777 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.887710 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 19:33:27.888041 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.887940 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mghmn\"" May 27 19:33:27.888041 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:27.887979 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 19:33:28.014516 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bafaf84-56fa-4853-944a-720b432958fb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.014702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.014702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-metrics-client-ca\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.014702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-tls\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.014702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-sys\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.014702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45ph\" (UniqueName: \"kubernetes.io/projected/3bafaf84-56fa-4853-944a-720b432958fb-kube-api-access-g45ph\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.014702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrvbd\" (UniqueName: \"kubernetes.io/projected/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-kube-api-access-xrvbd\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-textfile\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bafaf84-56fa-4853-944a-720b432958fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.014973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.015025 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.015009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.015357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.015038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d266g\" (UniqueName: \"kubernetes.io/projected/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-api-access-d266g\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.015357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.015083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-root\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.015357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.015107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.015357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.015148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bafaf84-56fa-4853-944a-720b432958fb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.015357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.015178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-wtmp\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.070364 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.070326 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjv27" event={"ID":"587775c1-24d5-4668-9a58-dc877febc9c3","Type":"ContainerStarted","Data":"a51386866ae4b7f2bb4837862f2c89364210d11276c9d9fb8e7ad57d8c997a1a"} May 27 19:33:28.115886 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.115814 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bafaf84-56fa-4853-944a-720b432958fb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.115886 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.115849 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-wtmp\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116108 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.115999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-wtmp\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116108 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116020 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bafaf84-56fa-4853-944a-720b432958fb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.116108 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116069 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.116108 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116101 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-metrics-client-ca\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116128 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-tls\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116161 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-sys\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116192 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g45ph\" (UniqueName: \"kubernetes.io/projected/3bafaf84-56fa-4853-944a-720b432958fb-kube-api-access-g45ph\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.116306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116220 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.116306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116247 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrvbd\" (UniqueName: \"kubernetes.io/projected/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-kube-api-access-xrvbd\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116273 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-textfile\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116333 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116367 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bafaf84-56fa-4853-944a-720b432958fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116408 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116449 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-sys\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116548 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.116595 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116589 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d266g\" (UniqueName: \"kubernetes.io/projected/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-api-access-d266g\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.116970 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116643 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-root\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.116970 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116676 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.117176 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.116656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bafaf84-56fa-4853-944a-720b432958fb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.118120 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.117983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-metrics-client-ca\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.118120 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.118024 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.118312 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.118284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.118424 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.118327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-root\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.118491 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.118441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.120148 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.120121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-textfile\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.120314 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.120248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.120936 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.120851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bafaf84-56fa-4853-944a-720b432958fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.120936 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.120886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bafaf84-56fa-4853-944a-720b432958fb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.121388 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.121361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-tls\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.124439 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.122211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.124439 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.122306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.124439 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.123196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.127313 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.127265 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d266g\" (UniqueName: \"kubernetes.io/projected/d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196-kube-api-access-d266g\") pod \"kube-state-metrics-54fd6bc5c4-mnz5h\" (UID: \"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.128065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.128039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45ph\" (UniqueName: \"kubernetes.io/projected/3bafaf84-56fa-4853-944a-720b432958fb-kube-api-access-g45ph\") pod \"openshift-state-metrics-9c959559f-mj2qg\" (UID: \"3bafaf84-56fa-4853-944a-720b432958fb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.129962 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.129938 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrvbd\" (UniqueName: \"kubernetes.io/projected/def24bf3-3c27-43f8-b6f8-4c00bf0906ef-kube-api-access-xrvbd\") pod \"node-exporter-hd2vz\" (UID: \"def24bf3-3c27-43f8-b6f8-4c00bf0906ef\") " pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.150972 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.150947 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" May 27 19:33:28.179127 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.179062 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" May 27 19:33:28.197537 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.197132 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hd2vz" May 27 19:33:28.213105 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:28.213061 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef24bf3_3c27_43f8_b6f8_4c00bf0906ef.slice/crio-3928302139bd4538faf97dec062184fac5531af28728ad2249fad492c60533b3 WatchSource:0}: Error finding container 3928302139bd4538faf97dec062184fac5531af28728ad2249fad492c60533b3: Status 404 returned error can't find the container with id 3928302139bd4538faf97dec062184fac5531af28728ad2249fad492c60533b3 May 27 19:33:28.321400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.321366 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg"] May 27 19:33:28.328774 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:28.328742 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bafaf84_56fa_4853_944a_720b432958fb.slice/crio-999b129a824c053e0ae94deacddec628aa0cf2beb65e3e1b0b40034866ccb875 WatchSource:0}: Error finding container 999b129a824c053e0ae94deacddec628aa0cf2beb65e3e1b0b40034866ccb875: Status 404 returned error can't find the container with id 999b129a824c053e0ae94deacddec628aa0cf2beb65e3e1b0b40034866ccb875 May 27 19:33:28.350802 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.348369 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h"] May 27 19:33:28.352670 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:28.352643 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bd5d21_e3f8_42aa_a8b9_cbf8b1ceb196.slice/crio-79ab4f006b3f08acec766adce808acd7f38907b494ecbcc34047db0026d74104 WatchSource:0}: Error finding container 79ab4f006b3f08acec766adce808acd7f38907b494ecbcc34047db0026d74104: Status 404 returned error can't find the container with id 79ab4f006b3f08acec766adce808acd7f38907b494ecbcc34047db0026d74104 May 27 19:33:28.934401 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.934038 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:33:28.939296 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.938694 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:28.942509 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.941994 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ckqn2\"" May 27 19:33:28.942509 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.942307 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 19:33:28.943574 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943401 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 19:33:28.943574 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943413 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 19:33:28.943574 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943532 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 19:33:28.943787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943593 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 19:33:28.943787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943651 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 19:33:28.943787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943780 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 19:33:28.943953 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.943843 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 19:33:28.945148 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.944166 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 19:33:28.952542 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:28.952524 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:33:29.075350 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.075285 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" event={"ID":"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196","Type":"ContainerStarted","Data":"79ab4f006b3f08acec766adce808acd7f38907b494ecbcc34047db0026d74104"} May 27 19:33:29.078660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.078632 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" event={"ID":"3bafaf84-56fa-4853-944a-720b432958fb","Type":"ContainerStarted","Data":"729e27048053546d3f7f62cf3c71462b37987d2f8e4c5737fc8c294945a10916"} May 27 19:33:29.078789 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.078671 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" event={"ID":"3bafaf84-56fa-4853-944a-720b432958fb","Type":"ContainerStarted","Data":"131e53f85314197e001d64990dc59911ba27e626f376ddfd7264304816fb4029"} May 27 19:33:29.078789 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.078684 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" event={"ID":"3bafaf84-56fa-4853-944a-720b432958fb","Type":"ContainerStarted","Data":"999b129a824c053e0ae94deacddec628aa0cf2beb65e3e1b0b40034866ccb875"} May 27 19:33:29.080106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.080082 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd2vz" event={"ID":"def24bf3-3c27-43f8-b6f8-4c00bf0906ef","Type":"ContainerStarted","Data":"3928302139bd4538faf97dec062184fac5531af28728ad2249fad492c60533b3"} May 27 19:33:29.127495 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-volume\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127620 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-out\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127717 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.127787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqc4g\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-kube-api-access-tqc4g\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.128036 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-web-config\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.128036 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.128036 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.128036 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.127890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229414 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229362 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229414 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229420 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229659 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229476 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229659 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229512 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229659 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229569 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229659 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229593 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-volume\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229659 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229618 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.229931 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:29.229680 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 27 19:33:29.229931 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:29.229757 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls podName:69a78a18-c3a7-416f-b50c-4345b4cd7089 nodeName:}" failed. No retries permitted until 2026-05-27 19:33:29.729735875 +0000 UTC m=+53.508263239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089") : secret "alertmanager-main-tls" not found May 27 19:33:29.230073 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.229967 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230073 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230025 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230073 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230061 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-out\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230091 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230125 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqc4g\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-kube-api-access-tqc4g\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230180 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-web-config\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.230551 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.231061 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.230688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.234128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.234619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.234895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-out\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.235375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-web-config\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.235722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-volume\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236065 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.235770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.236493 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.236441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.237458 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.237393 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.239395 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.239358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqc4g\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-kube-api-access-tqc4g\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.735578 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.735544 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.738289 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.738261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:29.852981 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:29.852941 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 19:33:30.033871 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.033787 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-258f6" May 27 19:33:30.845567 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.845531 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64bbd49d6b-x6c46"] May 27 19:33:30.851760 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.851713 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.856678 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.856640 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fgd4n\"" May 27 19:33:30.856678 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.856668 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5ep05j7rhsq12\"" May 27 19:33:30.856872 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.856682 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 19:33:30.856872 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.856645 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 19:33:30.856872 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.856640 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 19:33:30.856872 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.856828 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 19:33:30.857113 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.857069 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 19:33:30.861014 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.860990 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64bbd49d6b-x6c46"] May 27 19:33:30.945925 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.945881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946110 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-tls\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946110 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-grpc-tls\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946214 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946325 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mdb\" (UniqueName: \"kubernetes.io/projected/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-kube-api-access-45mdb\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:30.946325 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:30.946263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-metrics-client-ca\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047165 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047130 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-tls\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047325 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047168 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047398 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047359 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047456 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-grpc-tls\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047456 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047438 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047545 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047470 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45mdb\" (UniqueName: \"kubernetes.io/projected/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-kube-api-access-45mdb\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047545 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-metrics-client-ca\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.047632 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.047573 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.048472 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.048417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-metrics-client-ca\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.050328 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.050299 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.050732 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.050707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.050927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.050853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-tls\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.050927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.050859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.050927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.050882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.051070 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.051048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-secret-grpc-tls\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.057157 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.057135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mdb\" (UniqueName: \"kubernetes.io/projected/2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc-kube-api-access-45mdb\") pod \"thanos-querier-64bbd49d6b-x6c46\" (UID: \"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc\") " pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:31.163640 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:31.163550 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:32.272925 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.271783 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6777cbd889-7wkrt"] May 27 19:33:32.278135 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.278110 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.281113 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.281085 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 27 19:33:32.282413 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.282382 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 19:33:32.282522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.282409 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6nn15urk1nggv\"" May 27 19:33:32.282522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.282423 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9dqxw\"" May 27 19:33:32.282522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.282382 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 27 19:33:32.282522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.282493 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 27 19:33:32.290958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.290937 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6777cbd889-7wkrt"] May 27 19:33:32.358612 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae154b2e-a80b-4d75-9f0d-a86de498d845-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.358779 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-client-ca-bundle\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.358779 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-secret-metrics-server-tls\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.358779 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdstq\" (UniqueName: \"kubernetes.io/projected/ae154b2e-a80b-4d75-9f0d-a86de498d845-kube-api-access-gdstq\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.358779 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae154b2e-a80b-4d75-9f0d-a86de498d845-audit-log\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.358995 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-secret-metrics-server-client-certs\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.358995 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.358962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae154b2e-a80b-4d75-9f0d-a86de498d845-metrics-server-audit-profiles\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460301 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460266 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-secret-metrics-server-client-certs\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460315 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae154b2e-a80b-4d75-9f0d-a86de498d845-metrics-server-audit-profiles\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460357 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae154b2e-a80b-4d75-9f0d-a86de498d845-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-client-ca-bundle\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460451 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-secret-metrics-server-tls\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460476 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdstq\" (UniqueName: \"kubernetes.io/projected/ae154b2e-a80b-4d75-9f0d-a86de498d845-kube-api-access-gdstq\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460791 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460522 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae154b2e-a80b-4d75-9f0d-a86de498d845-audit-log\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.460939 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.460869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae154b2e-a80b-4d75-9f0d-a86de498d845-audit-log\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.461492 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.461438 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae154b2e-a80b-4d75-9f0d-a86de498d845-metrics-server-audit-profiles\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.461563 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.461531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae154b2e-a80b-4d75-9f0d-a86de498d845-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.463337 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.463314 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-secret-metrics-server-client-certs\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.463724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.463702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-secret-metrics-server-tls\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.463812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.463711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae154b2e-a80b-4d75-9f0d-a86de498d845-client-ca-bundle\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.469410 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.469390 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdstq\" (UniqueName: \"kubernetes.io/projected/ae154b2e-a80b-4d75-9f0d-a86de498d845-kube-api-access-gdstq\") pod \"metrics-server-6777cbd889-7wkrt\" (UID: \"ae154b2e-a80b-4d75-9f0d-a86de498d845\") " pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.589519 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.589025 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:32.641757 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.641724 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5"] May 27 19:33:32.676915 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.676864 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5"] May 27 19:33:32.677079 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.677023 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:32.679717 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.679677 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-c5d2q\"" May 27 19:33:32.679850 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.679832 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 27 19:33:32.763035 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.763000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0463daa0-4c0c-4717-b9ae-fbc176467933-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2hpn5\" (UID: \"0463daa0-4c0c-4717-b9ae-fbc176467933\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:32.863610 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:32.863531 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0463daa0-4c0c-4717-b9ae-fbc176467933-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2hpn5\" (UID: \"0463daa0-4c0c-4717-b9ae-fbc176467933\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:32.863733 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:32.863694 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 27 19:33:32.863783 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:33:32.863765 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0463daa0-4c0c-4717-b9ae-fbc176467933-monitoring-plugin-cert podName:0463daa0-4c0c-4717-b9ae-fbc176467933 nodeName:}" failed. No retries permitted until 2026-05-27 19:33:33.363746653 +0000 UTC m=+57.142274020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0463daa0-4c0c-4717-b9ae-fbc176467933-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-2hpn5" (UID: "0463daa0-4c0c-4717-b9ae-fbc176467933") : secret "monitoring-plugin-cert" not found May 27 19:33:33.092468 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.092431 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss"] May 27 19:33:33.105674 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.105467 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.107378 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.107338 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss"] May 27 19:33:33.108538 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.108315 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 19:33:33.108538 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.108384 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ng82l\"" May 27 19:33:33.108538 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.108424 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 19:33:33.108538 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.108445 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 19:33:33.109300 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.109278 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 19:33:33.109465 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.109378 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 19:33:33.113514 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.113491 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 19:33:33.165789 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.165756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr677\" (UniqueName: \"kubernetes.io/projected/a41bdd0f-2d09-43e7-b659-aec13d390774-kube-api-access-mr677\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.165981 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.165806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-secret-telemeter-client\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.165981 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.165896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-serving-certs-ca-bundle\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.165981 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.165961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-telemeter-client-tls\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.166152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.166019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.166152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.166083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-federate-client-tls\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.166152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.166102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-metrics-client-ca\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.166316 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.166164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267450 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-telemeter-client-tls\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267647 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267500 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267647 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267556 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-federate-client-tls\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267647 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267585 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-metrics-client-ca\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267647 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267622 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267848 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267673 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mr677\" (UniqueName: \"kubernetes.io/projected/a41bdd0f-2d09-43e7-b659-aec13d390774-kube-api-access-mr677\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267848 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267718 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-secret-telemeter-client\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.267848 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.267791 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-serving-certs-ca-bundle\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.268677 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.268627 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-serving-certs-ca-bundle\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.268814 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.268791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.269055 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.269002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a41bdd0f-2d09-43e7-b659-aec13d390774-metrics-client-ca\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.270850 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.270829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-telemeter-client-tls\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.270968 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.270923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-federate-client-tls\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.271175 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.271154 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.271260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.271243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a41bdd0f-2d09-43e7-b659-aec13d390774-secret-telemeter-client\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.276780 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.276755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr677\" (UniqueName: \"kubernetes.io/projected/a41bdd0f-2d09-43e7-b659-aec13d390774-kube-api-access-mr677\") pod \"telemeter-client-56f9c7ccb6-9lvss\" (UID: \"a41bdd0f-2d09-43e7-b659-aec13d390774\") " pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.369159 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.369042 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0463daa0-4c0c-4717-b9ae-fbc176467933-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2hpn5\" (UID: \"0463daa0-4c0c-4717-b9ae-fbc176467933\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:33.371784 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.371758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0463daa0-4c0c-4717-b9ae-fbc176467933-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2hpn5\" (UID: \"0463daa0-4c0c-4717-b9ae-fbc176467933\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:33.418234 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.418200 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" May 27 19:33:33.589048 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:33.589010 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:34.049533 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.049496 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:33:34.080687 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.080659 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:33:34.080856 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.080837 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.083775 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.083750 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d4w66\"" May 27 19:33:34.084228 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.083984 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 19:33:34.084228 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.083994 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 19:33:34.084228 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084071 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 19:33:34.084228 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084140 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 19:33:34.084228 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.083747 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 19:33:34.084228 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084228 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 19:33:34.084602 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084518 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 19:33:34.084602 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084568 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 19:33:34.084602 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084569 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 19:33:34.084775 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084588 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-edav3r7dki9ne\"" May 27 19:33:34.084888 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084869 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 19:33:34.084888 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.084885 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 19:33:34.087353 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.087332 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 19:33:34.176605 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-web-config\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176776 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176776 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176776 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.176937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config-out\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177098 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.176950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177098 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177098 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177098 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj22r\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-kube-api-access-vj22r\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177266 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.177491 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.177269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278381 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278399 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278420 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vj22r\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-kube-api-access-vj22r\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278559 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278614 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278681 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-web-config\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278715 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278748 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278778 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278833 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278890 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.278958 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.278993 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config-out\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279031 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279065 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279096 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279126 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279753 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279658 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.279753 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.279720 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.281234 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.281207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.282174 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.282113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.283627 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.283583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.284105 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.284021 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.284105 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.284054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.286863 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.286421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config-out\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.286863 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.286709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.287718 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.287246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.287718 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.287270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.287718 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.287312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-web-config\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.287718 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.287681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.287887 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.287717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.287887 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.287806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.288822 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.288796 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.290024 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.290006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj22r\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-kube-api-access-vj22r\") pod \"prometheus-k8s-0\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:34.395022 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:34.394925 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:33:37.010422 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:37.010387 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpjx2" May 27 19:33:39.859941 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:39.859917 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:33:39.860478 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:39.860338 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5"] May 27 19:33:39.873421 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:39.873394 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:33:39.896136 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:39.896027 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss"] May 27 19:33:39.910932 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:39.910884 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41bdd0f_2d09_43e7_b659_aec13d390774.slice/crio-40f04bc90f85b9568a422a003598e3a8bc836fc7148aff27208319824c7d0164 WatchSource:0}: Error finding container 40f04bc90f85b9568a422a003598e3a8bc836fc7148aff27208319824c7d0164: Status 404 returned error can't find the container with id 40f04bc90f85b9568a422a003598e3a8bc836fc7148aff27208319824c7d0164 May 27 19:33:39.917728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:39.917698 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6777cbd889-7wkrt"] May 27 19:33:39.926305 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:39.926276 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64bbd49d6b-x6c46"] May 27 19:33:40.115767 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.115725 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-6ntxh" event={"ID":"8e2f3d98-7c67-4cda-984b-9676b7af7d0d","Type":"ContainerStarted","Data":"fc6efacb61d45406097dd863067c3dc634e3f2efb3714111bfc934b06aedf3f0"} May 27 19:33:40.116209 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.116157 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:40.117608 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.117582 2565 patch_prober.go:28] interesting pod/downloads-57bd96b888-6ntxh container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.8:8080/\": dial tcp 10.134.0.8:8080: connect: connection refused" start-of-body= May 27 19:33:40.117721 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.117629 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-6ntxh" podUID="8e2f3d98-7c67-4cda-984b-9676b7af7d0d" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.8:8080/\": dial tcp 10.134.0.8:8080: connect: connection refused" May 27 19:33:40.118017 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.117994 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjv27" event={"ID":"587775c1-24d5-4668-9a58-dc877febc9c3","Type":"ContainerStarted","Data":"26a4e224d84f1deec6903f7190ba16fb251bdfc151b4b5de24a38b4c6803fb38"} May 27 19:33:40.119613 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.119591 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" event={"ID":"ae154b2e-a80b-4d75-9f0d-a86de498d845","Type":"ContainerStarted","Data":"d667e4f68c69d8900a26eec7788a0af03fe3f4ecedd07303013a79d4c8b1035d"} May 27 19:33:40.120984 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.120931 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b854b4f94-56wzj" event={"ID":"e9c5e6df-d000-4125-8373-c46f8f4d515f","Type":"ContainerStarted","Data":"d9837a98dee64f70cce40a88a33636cfd1e2bd391289a4044ddd3015bc0bfbcb"} May 27 19:33:40.122514 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.122488 2565 generic.go:358] "Generic (PLEG): container finished" podID="def24bf3-3c27-43f8-b6f8-4c00bf0906ef" containerID="6c64a2a85e8f4e3f5a616dbfeb00dd8bca93d3299d1fe5fc10d23ff6c4139b38" exitCode=0 May 27 19:33:40.122693 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.122511 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd2vz" event={"ID":"def24bf3-3c27-43f8-b6f8-4c00bf0906ef","Type":"ContainerDied","Data":"6c64a2a85e8f4e3f5a616dbfeb00dd8bca93d3299d1fe5fc10d23ff6c4139b38"} May 27 19:33:40.124999 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.124956 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"e6cc267a05f927818ad08da140344ed5e5b51f62956c143138063411a2fdbe22"} May 27 19:33:40.128823 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.128771 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" event={"ID":"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196","Type":"ContainerStarted","Data":"04f384e344142018aa602806ee51395b867c9c52d3b0721bed48ee665577ee1c"} May 27 19:33:40.128932 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.128840 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" event={"ID":"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196","Type":"ContainerStarted","Data":"d5c688730f311900d71286e5c5a6dcb47d00763e5cfc026db2c740a675a27c42"} May 27 19:33:40.128932 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.128868 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" event={"ID":"d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196","Type":"ContainerStarted","Data":"df818c54fa7471bbd4e7e961cff431220f4883453599ea3ba9718d78d84fe65f"} May 27 19:33:40.129940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.129868 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" event={"ID":"a41bdd0f-2d09-43e7-b659-aec13d390774","Type":"ContainerStarted","Data":"40f04bc90f85b9568a422a003598e3a8bc836fc7148aff27208319824c7d0164"} May 27 19:33:40.131950 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.131924 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" event={"ID":"3bafaf84-56fa-4853-944a-720b432958fb","Type":"ContainerStarted","Data":"8f344aeaf0c73a7d272c63a693203971670806020a8865896ee7222ec07a0130"} May 27 19:33:40.135878 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.135736 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"01842fe329ce03462bb10d282e3a55b579a89fffc9d8238f78aed21b98374695"} May 27 19:33:40.136393 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.136342 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-6ntxh" podStartSLOduration=4.178920142 podStartE2EDuration="24.136331204s" podCreationTimestamp="2026-05-27 19:33:16 +0000 UTC" firstStartedPulling="2026-05-27 19:33:19.584102205 +0000 UTC m=+43.362629554" lastFinishedPulling="2026-05-27 19:33:39.541513254 +0000 UTC m=+63.320040616" observedRunningTime="2026-05-27 19:33:40.134929168 +0000 UTC m=+63.913456535" watchObservedRunningTime="2026-05-27 19:33:40.136331204 +0000 UTC m=+63.914858577" May 27 19:33:40.137075 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.137051 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" event={"ID":"0463daa0-4c0c-4717-b9ae-fbc176467933","Type":"ContainerStarted","Data":"313ca202411edcc6b9ea434954937378472bbe4106544add14eee487b43ef333"} May 27 19:33:40.138940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.138799 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"6eb3daabb1911d8f012d6ab2e1ebb5d0a7b9b139e2b8cc580a8c4eac5c168734"} May 27 19:33:40.158257 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.158216 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gjv27" podStartSLOduration=1.6349469920000002 podStartE2EDuration="14.158203491s" podCreationTimestamp="2026-05-27 19:33:26 +0000 UTC" firstStartedPulling="2026-05-27 19:33:27.008060301 +0000 UTC m=+50.786587651" lastFinishedPulling="2026-05-27 19:33:39.531316795 +0000 UTC m=+63.309844150" observedRunningTime="2026-05-27 19:33:40.157742325 +0000 UTC m=+63.936269698" watchObservedRunningTime="2026-05-27 19:33:40.158203491 +0000 UTC m=+63.936730863" May 27 19:33:40.181751 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.181698 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b854b4f94-56wzj" podStartSLOduration=1.664809495 podStartE2EDuration="14.181681069s" podCreationTimestamp="2026-05-27 19:33:26 +0000 UTC" firstStartedPulling="2026-05-27 19:33:27.018077094 +0000 UTC m=+50.796604450" lastFinishedPulling="2026-05-27 19:33:39.534948658 +0000 UTC m=+63.313476024" observedRunningTime="2026-05-27 19:33:40.179988774 +0000 UTC m=+63.958516139" watchObservedRunningTime="2026-05-27 19:33:40.181681069 +0000 UTC m=+63.960208443" May 27 19:33:40.199758 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.199691 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mj2qg" podStartSLOduration=2.075017327 podStartE2EDuration="13.19967325s" podCreationTimestamp="2026-05-27 19:33:27 +0000 UTC" firstStartedPulling="2026-05-27 19:33:28.508644891 +0000 UTC m=+52.287172249" lastFinishedPulling="2026-05-27 19:33:39.633300805 +0000 UTC m=+63.411828172" observedRunningTime="2026-05-27 19:33:40.197725733 +0000 UTC m=+63.976253110" watchObservedRunningTime="2026-05-27 19:33:40.19967325 +0000 UTC m=+63.978200623" May 27 19:33:40.245173 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:40.245121 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mnz5h" podStartSLOduration=2.060432701 podStartE2EDuration="13.245103486s" podCreationTimestamp="2026-05-27 19:33:27 +0000 UTC" firstStartedPulling="2026-05-27 19:33:28.355704586 +0000 UTC m=+52.134231951" lastFinishedPulling="2026-05-27 19:33:39.540375375 +0000 UTC m=+63.318902736" observedRunningTime="2026-05-27 19:33:40.243711245 +0000 UTC m=+64.022238610" watchObservedRunningTime="2026-05-27 19:33:40.245103486 +0000 UTC m=+64.023630859" May 27 19:33:41.150542 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:41.150246 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd2vz" event={"ID":"def24bf3-3c27-43f8-b6f8-4c00bf0906ef","Type":"ContainerStarted","Data":"8b551e2aa01fd9eaaee013b791607eb6ed59d46896a29074816a80d1f8110dc5"} May 27 19:33:41.150542 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:41.150302 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd2vz" event={"ID":"def24bf3-3c27-43f8-b6f8-4c00bf0906ef","Type":"ContainerStarted","Data":"fc0714b32442b1e921d19eacaf13ea701fb9afc76a6fa25768fcb5fa101df5d8"} May 27 19:33:41.168176 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:41.168135 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-6ntxh" May 27 19:33:41.181185 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:41.181129 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hd2vz" podStartSLOduration=3.17424924 podStartE2EDuration="14.181112816s" podCreationTimestamp="2026-05-27 19:33:27 +0000 UTC" firstStartedPulling="2026-05-27 19:33:28.217235447 +0000 UTC m=+51.995762809" lastFinishedPulling="2026-05-27 19:33:39.224099027 +0000 UTC m=+63.002626385" observedRunningTime="2026-05-27 19:33:41.179920419 +0000 UTC m=+64.958447792" watchObservedRunningTime="2026-05-27 19:33:41.181112816 +0000 UTC m=+64.959640189" May 27 19:33:42.579596 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.579189 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:42.582452 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.582424 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 19:33:42.592608 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.592578 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4efbc00-a9d7-401c-9c58-71101a6cd3aa-metrics-certs\") pod \"network-metrics-daemon-ssjlj\" (UID: \"e4efbc00-a9d7-401c-9c58-71101a6cd3aa\") " pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:42.680479 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.680410 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:42.684498 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.684474 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 19:33:42.693636 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.693608 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 19:33:42.705186 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.705131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2mg\" (UniqueName: \"kubernetes.io/projected/2baecdb8-6eb5-4fa4-80ef-ed27f262f6de-kube-api-access-bq2mg\") pod \"network-check-target-4dcwc\" (UID: \"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de\") " pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:42.864257 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.864142 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzfh2\"" May 27 19:33:42.868340 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.868320 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hg7p\"" May 27 19:33:42.871510 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.871448 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:42.876135 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:42.876115 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssjlj" May 27 19:33:45.037933 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:45.037839 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b854b4f94-56wzj"] May 27 19:33:45.868014 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:45.866748 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dcwc"] May 27 19:33:45.901412 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:45.901381 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ssjlj"] May 27 19:33:45.988963 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:45.988897 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baecdb8_6eb5_4fa4_80ef_ed27f262f6de.slice/crio-7ec6e8a7328ce8406e573c60c1116dd4b115af34da2bc600bc37340bb467a25a WatchSource:0}: Error finding container 7ec6e8a7328ce8406e573c60c1116dd4b115af34da2bc600bc37340bb467a25a: Status 404 returned error can't find the container with id 7ec6e8a7328ce8406e573c60c1116dd4b115af34da2bc600bc37340bb467a25a May 27 19:33:45.989870 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:33:45.989822 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4efbc00_a9d7_401c_9c58_71101a6cd3aa.slice/crio-1bbbfcf21f8b7b8bb0affff35ba6f328c220a8ffd6c3f852aa9635742dd9eb19 WatchSource:0}: Error finding container 1bbbfcf21f8b7b8bb0affff35ba6f328c220a8ffd6c3f852aa9635742dd9eb19: Status 404 returned error can't find the container with id 1bbbfcf21f8b7b8bb0affff35ba6f328c220a8ffd6c3f852aa9635742dd9eb19 May 27 19:33:46.172483 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.172454 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" event={"ID":"ae154b2e-a80b-4d75-9f0d-a86de498d845","Type":"ContainerStarted","Data":"512612dd517a98eea569e406223c35b0a4ca4b6183ea1cedf29b35c94bff09cd"} May 27 19:33:46.174605 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.174568 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"76087f417c23aa293367dd5172c0bfaf983899fec430b63899b681315f40cd3a"} May 27 19:33:46.176018 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.175988 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" event={"ID":"0463daa0-4c0c-4717-b9ae-fbc176467933","Type":"ContainerStarted","Data":"83bdc9fbbfa01647bcd800f0566c15670f5a573206efe11d4269d518f3cab0dc"} May 27 19:33:46.178348 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.177246 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:46.178577 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.178477 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" exitCode=0 May 27 19:33:46.178577 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.178543 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} May 27 19:33:46.180416 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.180270 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssjlj" event={"ID":"e4efbc00-a9d7-401c-9c58-71101a6cd3aa","Type":"ContainerStarted","Data":"1bbbfcf21f8b7b8bb0affff35ba6f328c220a8ffd6c3f852aa9635742dd9eb19"} May 27 19:33:46.182798 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.182750 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dcwc" event={"ID":"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de","Type":"ContainerStarted","Data":"7ec6e8a7328ce8406e573c60c1116dd4b115af34da2bc600bc37340bb467a25a"} May 27 19:33:46.184314 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.184288 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" event={"ID":"a41bdd0f-2d09-43e7-b659-aec13d390774","Type":"ContainerStarted","Data":"719db6e742e6f278911e26c25d40223466abb3be95346ef43f5a8c87479cb613"} May 27 19:33:46.186223 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.186186 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" May 27 19:33:46.188541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.188273 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="3faf1c09a9fe03533999d3d13a5f5e0d527f7ae8c82deb9253c47f4d2319ec87" exitCode=0 May 27 19:33:46.188541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.188308 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"3faf1c09a9fe03533999d3d13a5f5e0d527f7ae8c82deb9253c47f4d2319ec87"} May 27 19:33:46.192421 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.192138 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" podStartSLOduration=8.440097918 podStartE2EDuration="14.192125877s" podCreationTimestamp="2026-05-27 19:33:32 +0000 UTC" firstStartedPulling="2026-05-27 19:33:39.936049948 +0000 UTC m=+63.714577302" lastFinishedPulling="2026-05-27 19:33:45.688077911 +0000 UTC m=+69.466605261" observedRunningTime="2026-05-27 19:33:46.189994922 +0000 UTC m=+69.968522294" watchObservedRunningTime="2026-05-27 19:33:46.192125877 +0000 UTC m=+69.970653248" May 27 19:33:46.876571 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.876520 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:33:46.888840 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:46.887332 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2hpn5" podStartSLOduration=9.07980146 podStartE2EDuration="14.88731417s" podCreationTimestamp="2026-05-27 19:33:32 +0000 UTC" firstStartedPulling="2026-05-27 19:33:39.877785371 +0000 UTC m=+63.656312722" lastFinishedPulling="2026-05-27 19:33:45.685298066 +0000 UTC m=+69.463825432" observedRunningTime="2026-05-27 19:33:46.274507425 +0000 UTC m=+70.053034800" watchObservedRunningTime="2026-05-27 19:33:46.88731417 +0000 UTC m=+70.665841543" May 27 19:33:47.200305 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:47.200224 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"e6baec06ee4601ddd71c5bec1a76153673d77135f10621e2a7b58349fb1102f9"} May 27 19:33:47.200305 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:47.200271 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"2fd44d4c4087a736ac653589e8d3605e9c007d2c68cdf061ebbf597ec66d7a35"} May 27 19:33:47.207139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:47.206527 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" event={"ID":"a41bdd0f-2d09-43e7-b659-aec13d390774","Type":"ContainerStarted","Data":"8ef47cc0056ea9f3a6f54cc6fc2bbe5d2e4e483765dfea4d668b8f1b79dca721"} May 27 19:33:47.207139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:47.206565 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" event={"ID":"a41bdd0f-2d09-43e7-b659-aec13d390774","Type":"ContainerStarted","Data":"7ef30100780296e83fc19319eb66c09eff389c7b7ac3ca40516c597f0928a795"} May 27 19:33:47.233236 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:47.232995 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56f9c7ccb6-9lvss" podStartSLOduration=8.463783425999999 podStartE2EDuration="14.232975526s" podCreationTimestamp="2026-05-27 19:33:33 +0000 UTC" firstStartedPulling="2026-05-27 19:33:39.920636327 +0000 UTC m=+63.699163686" lastFinishedPulling="2026-05-27 19:33:45.689828422 +0000 UTC m=+69.468355786" observedRunningTime="2026-05-27 19:33:47.230407565 +0000 UTC m=+71.008934939" watchObservedRunningTime="2026-05-27 19:33:47.232975526 +0000 UTC m=+71.011502899" May 27 19:33:52.227641 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:52.227607 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"823a2ac8a167a2489ff09602cf2a4ec9dba09fcb8a5bf4c7d4053c4dd1fbaf8f"} May 27 19:33:52.229698 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:52.229660 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} May 27 19:33:52.231616 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:52.231580 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssjlj" event={"ID":"e4efbc00-a9d7-401c-9c58-71101a6cd3aa","Type":"ContainerStarted","Data":"1fe953eab2454e1f09f968c51db763aec02fb441c37e414a72f89cf2484dbf8d"} May 27 19:33:52.234442 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:52.234421 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"6fb41ccd66669f82cf835cf45127e4ee71e7d4a3de64c50ba05a0101dafd596d"} May 27 19:33:52.589374 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:52.589344 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:52.589529 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:52.589436 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:33:53.241267 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.241230 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"6531317c4d461b1c5ee97ab9b7ea18fb62b566ab88dab006116940fdc3c443ba"} May 27 19:33:53.241267 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.241271 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" event={"ID":"2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc","Type":"ContainerStarted","Data":"c1fe99d50325ef429c5da00dc6fb6dafd8a40f21adf29640dcbb3a9fd800dd44"} May 27 19:33:53.241814 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.241512 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:53.244487 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.244459 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} May 27 19:33:53.244626 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.244490 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} May 27 19:33:53.244626 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.244505 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} May 27 19:33:53.244626 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.244518 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} May 27 19:33:53.244626 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.244531 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerStarted","Data":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} May 27 19:33:53.246186 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.246165 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssjlj" event={"ID":"e4efbc00-a9d7-401c-9c58-71101a6cd3aa","Type":"ContainerStarted","Data":"43f0b978139636a042a26ff3ed50f0f327d449481a7033593c90ebd6f6ac2ef6"} May 27 19:33:53.251672 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.249017 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" May 27 19:33:53.251672 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.249045 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dcwc" event={"ID":"2baecdb8-6eb5-4fa4-80ef-ed27f262f6de","Type":"ContainerStarted","Data":"d567890e0f15fc76d3212f99c67cfa3c2f6b87f2ea59deaf6d30456b7be19a0d"} May 27 19:33:53.251672 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.249578 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:33:53.254549 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.254528 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"c3e697130c2c93e178c48d9a188ed03da559f09aa2797b5436fd0b92166e8e81"} May 27 19:33:53.254628 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.254557 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"be80ea4377fb851e274277b1739f6f7f2adcf4e313b3c3ad1bf85e45aa57e8b1"} May 27 19:33:53.254628 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.254572 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"666953a3dfed14646acf2414eaf51042d4dc3728360aa6f39fd15b0485122131"} May 27 19:33:53.254628 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.254584 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"6d2a70f705ea33e9faf85f6fb5b95a5f11cc57864446cec5027fa185a4e35420"} May 27 19:33:53.254628 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.254593 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerStarted","Data":"0861ad43200655680b2dda059796142a234de6be671e837dd9a05fa4b0247328"} May 27 19:33:53.268388 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.268344 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64bbd49d6b-x6c46" podStartSLOduration=11.41324323 podStartE2EDuration="23.268330302s" podCreationTimestamp="2026-05-27 19:33:30 +0000 UTC" firstStartedPulling="2026-05-27 19:33:39.944647833 +0000 UTC m=+63.723175198" lastFinishedPulling="2026-05-27 19:33:51.799734917 +0000 UTC m=+75.578262270" observedRunningTime="2026-05-27 19:33:53.2653634 +0000 UTC m=+77.043890773" watchObservedRunningTime="2026-05-27 19:33:53.268330302 +0000 UTC m=+77.046857677" May 27 19:33:53.292348 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.292303 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.373120328 podStartE2EDuration="19.292292184s" podCreationTimestamp="2026-05-27 19:33:34 +0000 UTC" firstStartedPulling="2026-05-27 19:33:39.888119371 +0000 UTC m=+63.666646725" lastFinishedPulling="2026-05-27 19:33:51.807291228 +0000 UTC m=+75.585818581" observedRunningTime="2026-05-27 19:33:53.291123063 +0000 UTC m=+77.069650447" watchObservedRunningTime="2026-05-27 19:33:53.292292184 +0000 UTC m=+77.070819556" May 27 19:33:53.311514 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.311477 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ssjlj" podStartSLOduration=71.53292155 podStartE2EDuration="1m17.311466433s" podCreationTimestamp="2026-05-27 19:32:36 +0000 UTC" firstStartedPulling="2026-05-27 19:33:46.021262512 +0000 UTC m=+69.799789862" lastFinishedPulling="2026-05-27 19:33:51.799807381 +0000 UTC m=+75.578334745" observedRunningTime="2026-05-27 19:33:53.309918042 +0000 UTC m=+77.088445431" watchObservedRunningTime="2026-05-27 19:33:53.311466433 +0000 UTC m=+77.089993804" May 27 19:33:53.325169 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.325134 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4dcwc" podStartSLOduration=70.192382439 podStartE2EDuration="1m16.32512371s" podCreationTimestamp="2026-05-27 19:32:37 +0000 UTC" firstStartedPulling="2026-05-27 19:33:46.021261179 +0000 UTC m=+69.799788529" lastFinishedPulling="2026-05-27 19:33:52.154002436 +0000 UTC m=+75.932529800" observedRunningTime="2026-05-27 19:33:53.324510159 +0000 UTC m=+77.103037727" watchObservedRunningTime="2026-05-27 19:33:53.32512371 +0000 UTC m=+77.103651097" May 27 19:33:53.376053 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:53.376006 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=13.451008681 podStartE2EDuration="25.375989434s" podCreationTimestamp="2026-05-27 19:33:28 +0000 UTC" firstStartedPulling="2026-05-27 19:33:39.876858232 +0000 UTC m=+63.655385589" lastFinishedPulling="2026-05-27 19:33:51.801838992 +0000 UTC m=+75.580366342" observedRunningTime="2026-05-27 19:33:53.374623696 +0000 UTC m=+77.153151074" watchObservedRunningTime="2026-05-27 19:33:53.375989434 +0000 UTC m=+77.154516812" May 27 19:33:54.395376 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:33:54.395340 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:10.064431 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.064283 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b854b4f94-56wzj" podUID="e9c5e6df-d000-4125-8373-c46f8f4d515f" containerName="console" containerID="cri-o://d9837a98dee64f70cce40a88a33636cfd1e2bd391289a4044ddd3015bc0bfbcb" gracePeriod=15 May 27 19:34:10.311596 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.311564 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b854b4f94-56wzj_e9c5e6df-d000-4125-8373-c46f8f4d515f/console/0.log" May 27 19:34:10.311708 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.311608 2565 generic.go:358] "Generic (PLEG): container finished" podID="e9c5e6df-d000-4125-8373-c46f8f4d515f" containerID="d9837a98dee64f70cce40a88a33636cfd1e2bd391289a4044ddd3015bc0bfbcb" exitCode=2 May 27 19:34:10.311708 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.311672 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b854b4f94-56wzj" event={"ID":"e9c5e6df-d000-4125-8373-c46f8f4d515f","Type":"ContainerDied","Data":"d9837a98dee64f70cce40a88a33636cfd1e2bd391289a4044ddd3015bc0bfbcb"} May 27 19:34:10.311708 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.311701 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b854b4f94-56wzj" event={"ID":"e9c5e6df-d000-4125-8373-c46f8f4d515f","Type":"ContainerDied","Data":"767a8656517e4bc535441822992d02347cb79a7a5aedf0239ad74035556a8ad0"} May 27 19:34:10.311836 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.311717 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="767a8656517e4bc535441822992d02347cb79a7a5aedf0239ad74035556a8ad0" May 27 19:34:10.312705 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.312684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b854b4f94-56wzj_e9c5e6df-d000-4125-8373-c46f8f4d515f/console/0.log" May 27 19:34:10.312827 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.312765 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:34:10.346270 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346214 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-config\") pod \"e9c5e6df-d000-4125-8373-c46f8f4d515f\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " May 27 19:34:10.346270 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346250 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-oauth-config\") pod \"e9c5e6df-d000-4125-8373-c46f8f4d515f\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " May 27 19:34:10.346442 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346280 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-service-ca\") pod \"e9c5e6df-d000-4125-8373-c46f8f4d515f\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " May 27 19:34:10.346442 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346309 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvq2m\" (UniqueName: \"kubernetes.io/projected/e9c5e6df-d000-4125-8373-c46f8f4d515f-kube-api-access-vvq2m\") pod \"e9c5e6df-d000-4125-8373-c46f8f4d515f\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " May 27 19:34:10.346442 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346343 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-oauth-serving-cert\") pod \"e9c5e6df-d000-4125-8373-c46f8f4d515f\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " May 27 19:34:10.346442 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346383 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-serving-cert\") pod \"e9c5e6df-d000-4125-8373-c46f8f4d515f\" (UID: \"e9c5e6df-d000-4125-8373-c46f8f4d515f\") " May 27 19:34:10.346699 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346670 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-config" (OuterVolumeSpecName: "console-config") pod "e9c5e6df-d000-4125-8373-c46f8f4d515f" (UID: "e9c5e6df-d000-4125-8373-c46f8f4d515f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:10.346793 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346740 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9c5e6df-d000-4125-8373-c46f8f4d515f" (UID: "e9c5e6df-d000-4125-8373-c46f8f4d515f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:10.346959 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.346933 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9c5e6df-d000-4125-8373-c46f8f4d515f" (UID: "e9c5e6df-d000-4125-8373-c46f8f4d515f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:10.348640 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.348600 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9c5e6df-d000-4125-8373-c46f8f4d515f" (UID: "e9c5e6df-d000-4125-8373-c46f8f4d515f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:10.348739 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.348708 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9c5e6df-d000-4125-8373-c46f8f4d515f" (UID: "e9c5e6df-d000-4125-8373-c46f8f4d515f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:10.348884 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.348860 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c5e6df-d000-4125-8373-c46f8f4d515f-kube-api-access-vvq2m" (OuterVolumeSpecName: "kube-api-access-vvq2m") pod "e9c5e6df-d000-4125-8373-c46f8f4d515f" (UID: "e9c5e6df-d000-4125-8373-c46f8f4d515f"). InnerVolumeSpecName "kube-api-access-vvq2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:34:10.447391 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.447349 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-serving-cert\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:10.447522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.447414 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-config\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:10.447522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.447429 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9c5e6df-d000-4125-8373-c46f8f4d515f-console-oauth-config\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:10.447522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.447453 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-service-ca\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:10.447522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.447468 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvq2m\" (UniqueName: \"kubernetes.io/projected/e9c5e6df-d000-4125-8373-c46f8f4d515f-kube-api-access-vvq2m\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:10.447522 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:10.447480 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9c5e6df-d000-4125-8373-c46f8f4d515f-oauth-serving-cert\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:11.314647 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:11.314616 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b854b4f94-56wzj" May 27 19:34:11.339038 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:11.339008 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b854b4f94-56wzj"] May 27 19:34:11.342206 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:11.342183 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b854b4f94-56wzj"] May 27 19:34:12.594894 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:12.594866 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:34:12.598715 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:12.598692 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6777cbd889-7wkrt" May 27 19:34:12.854506 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:12.854416 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9c5e6df-d000-4125-8373-c46f8f4d515f" path="/var/lib/kubelet/pods/e9c5e6df-d000-4125-8373-c46f8f4d515f/volumes" May 27 19:34:15.782431 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:15.782389 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:15.838996 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:15.838970 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:16.346645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:16.346617 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:25.268840 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:25.268801 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4dcwc" May 27 19:34:28.191996 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.191961 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:34:28.192411 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.192386 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="alertmanager" containerID="cri-o://6fb41ccd66669f82cf835cf45127e4ee71e7d4a3de64c50ba05a0101dafd596d" gracePeriod=120 May 27 19:34:28.192490 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.192444 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-metric" containerID="cri-o://be80ea4377fb851e274277b1739f6f7f2adcf4e313b3c3ad1bf85e45aa57e8b1" gracePeriod=120 May 27 19:34:28.192546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.192462 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-web" containerID="cri-o://6d2a70f705ea33e9faf85f6fb5b95a5f11cc57864446cec5027fa185a4e35420" gracePeriod=120 May 27 19:34:28.192546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.192485 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy" containerID="cri-o://666953a3dfed14646acf2414eaf51042d4dc3728360aa6f39fd15b0485122131" gracePeriod=120 May 27 19:34:28.192546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.192500 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="config-reloader" containerID="cri-o://0861ad43200655680b2dda059796142a234de6be671e837dd9a05fa4b0247328" gracePeriod=120 May 27 19:34:28.192688 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.192535 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="prom-label-proxy" containerID="cri-o://c3e697130c2c93e178c48d9a188ed03da559f09aa2797b5436fd0b92166e8e81" gracePeriod=120 May 27 19:34:28.371248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371179 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="c3e697130c2c93e178c48d9a188ed03da559f09aa2797b5436fd0b92166e8e81" exitCode=0 May 27 19:34:28.371248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371203 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="be80ea4377fb851e274277b1739f6f7f2adcf4e313b3c3ad1bf85e45aa57e8b1" exitCode=0 May 27 19:34:28.371248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371209 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="666953a3dfed14646acf2414eaf51042d4dc3728360aa6f39fd15b0485122131" exitCode=0 May 27 19:34:28.371248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371214 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="0861ad43200655680b2dda059796142a234de6be671e837dd9a05fa4b0247328" exitCode=0 May 27 19:34:28.371248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371220 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="6fb41ccd66669f82cf835cf45127e4ee71e7d4a3de64c50ba05a0101dafd596d" exitCode=0 May 27 19:34:28.371248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371237 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"c3e697130c2c93e178c48d9a188ed03da559f09aa2797b5436fd0b92166e8e81"} May 27 19:34:28.371690 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371258 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"be80ea4377fb851e274277b1739f6f7f2adcf4e313b3c3ad1bf85e45aa57e8b1"} May 27 19:34:28.371690 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371267 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"666953a3dfed14646acf2414eaf51042d4dc3728360aa6f39fd15b0485122131"} May 27 19:34:28.371690 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371276 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"0861ad43200655680b2dda059796142a234de6be671e837dd9a05fa4b0247328"} May 27 19:34:28.371690 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:28.371284 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"6fb41ccd66669f82cf835cf45127e4ee71e7d4a3de64c50ba05a0101dafd596d"} May 27 19:34:29.378275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.378248 2565 generic.go:358] "Generic (PLEG): container finished" podID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerID="6d2a70f705ea33e9faf85f6fb5b95a5f11cc57864446cec5027fa185a4e35420" exitCode=0 May 27 19:34:29.378584 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.378321 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"6d2a70f705ea33e9faf85f6fb5b95a5f11cc57864446cec5027fa185a4e35420"} May 27 19:34:29.455637 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.455617 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:29.506388 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506356 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-trusted-ca-bundle\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506402 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-web-config\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506434 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-cluster-tls-config\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506459 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-metrics-client-ca\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506503 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqc4g\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-kube-api-access-tqc4g\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506541 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506529 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-out\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506826 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506578 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.506939 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506767 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:29.507017 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506945 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:29.507017 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.506999 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.507117 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507050 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-metric\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.507117 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507080 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-main-db\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.507216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507124 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-web\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.507216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507153 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-tls-assets\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.507216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507190 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-volume\") pod \"69a78a18-c3a7-416f-b50c-4345b4cd7089\" (UID: \"69a78a18-c3a7-416f-b50c-4345b4cd7089\") " May 27 19:34:29.507766 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507458 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.507766 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.507483 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69a78a18-c3a7-416f-b50c-4345b4cd7089-metrics-client-ca\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.508894 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.508863 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:34:29.510307 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.510238 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.511317 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.511208 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-kube-api-access-tqc4g" (OuterVolumeSpecName: "kube-api-access-tqc4g") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "kube-api-access-tqc4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:34:29.511317 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.511254 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.511317 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.511280 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.511506 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.511331 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-out" (OuterVolumeSpecName: "config-out") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:34:29.511648 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.511621 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-volume" (OuterVolumeSpecName: "config-volume") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.511849 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.511825 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:34:29.513083 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.513063 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.516569 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.516546 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.523031 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.523004 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-web-config" (OuterVolumeSpecName: "web-config") pod "69a78a18-c3a7-416f-b50c-4345b4cd7089" (UID: "69a78a18-c3a7-416f-b50c-4345b4cd7089"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:29.608419 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608374 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqc4g\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-kube-api-access-tqc4g\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608419 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608408 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-out\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608419 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608420 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608434 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-main-tls\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608448 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608457 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69a78a18-c3a7-416f-b50c-4345b4cd7089-alertmanager-main-db\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608466 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608475 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69a78a18-c3a7-416f-b50c-4345b4cd7089-tls-assets\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608483 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-config-volume\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608491 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-web-config\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:29.608660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:29.608498 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69a78a18-c3a7-416f-b50c-4345b4cd7089-cluster-tls-config\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:30.384050 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.384017 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69a78a18-c3a7-416f-b50c-4345b4cd7089","Type":"ContainerDied","Data":"e6cc267a05f927818ad08da140344ed5e5b51f62956c143138063411a2fdbe22"} May 27 19:34:30.384413 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.384369 2565 scope.go:117] "RemoveContainer" containerID="c3e697130c2c93e178c48d9a188ed03da559f09aa2797b5436fd0b92166e8e81" May 27 19:34:30.384465 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.384442 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.394717 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.394698 2565 scope.go:117] "RemoveContainer" containerID="be80ea4377fb851e274277b1739f6f7f2adcf4e313b3c3ad1bf85e45aa57e8b1" May 27 19:34:30.406212 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.406194 2565 scope.go:117] "RemoveContainer" containerID="666953a3dfed14646acf2414eaf51042d4dc3728360aa6f39fd15b0485122131" May 27 19:34:30.412599 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.412574 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:34:30.414187 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.414142 2565 scope.go:117] "RemoveContainer" containerID="6d2a70f705ea33e9faf85f6fb5b95a5f11cc57864446cec5027fa185a4e35420" May 27 19:34:30.431520 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.431467 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:34:30.440150 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440127 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:34:30.440504 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440483 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-web" May 27 19:34:30.440504 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440498 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-web" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440514 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="config-reloader" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440520 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="config-reloader" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440535 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c5e6df-d000-4125-8373-c46f8f4d515f" containerName="console" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440543 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c5e6df-d000-4125-8373-c46f8f4d515f" containerName="console" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440554 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="alertmanager" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440559 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="alertmanager" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440566 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440570 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440580 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-metric" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440585 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-metric" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440591 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="prom-label-proxy" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440596 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="prom-label-proxy" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440603 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="init-config-reloader" May 27 19:34:30.440649 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440607 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="init-config-reloader" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440703 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="config-reloader" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440714 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440721 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="alertmanager" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440728 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9c5e6df-d000-4125-8373-c46f8f4d515f" containerName="console" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440734 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-web" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440740 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="prom-label-proxy" May 27 19:34:30.441260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.440746 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" containerName="kube-rbac-proxy-metric" May 27 19:34:30.444952 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.444929 2565 scope.go:117] "RemoveContainer" containerID="0861ad43200655680b2dda059796142a234de6be671e837dd9a05fa4b0247328" May 27 19:34:30.453345 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.453329 2565 scope.go:117] "RemoveContainer" containerID="6fb41ccd66669f82cf835cf45127e4ee71e7d4a3de64c50ba05a0101dafd596d" May 27 19:34:30.461476 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.461452 2565 scope.go:117] "RemoveContainer" containerID="3faf1c09a9fe03533999d3d13a5f5e0d527f7ae8c82deb9253c47f4d2319ec87" May 27 19:34:30.469270 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.469249 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:34:30.469449 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.469435 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.472477 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472458 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 19:34:30.472575 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472503 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 19:34:30.472575 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472458 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 19:34:30.472702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472585 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ckqn2\"" May 27 19:34:30.472702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472585 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 19:34:30.472702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472610 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 19:34:30.472934 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.472918 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 19:34:30.473085 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.473060 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 19:34:30.473171 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.473086 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 19:34:30.478150 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.478132 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 19:34:30.517362 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517480 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-web-config\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517480 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517480 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14eb7e6-5870-4784-8ec8-a57fec2400f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517581 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14eb7e6-5870-4784-8ec8-a57fec2400f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517581 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknhj\" (UniqueName: \"kubernetes.io/projected/c14eb7e6-5870-4784-8ec8-a57fec2400f0-kube-api-access-vknhj\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517581 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14eb7e6-5870-4784-8ec8-a57fec2400f0-config-out\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517669 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517669 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517669 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517669 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14eb7e6-5870-4784-8ec8-a57fec2400f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517788 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14eb7e6-5870-4784-8ec8-a57fec2400f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.517788 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.517703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618454 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618376 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618454 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618411 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-web-config\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618454 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618430 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618454 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618451 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14eb7e6-5870-4784-8ec8-a57fec2400f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14eb7e6-5870-4784-8ec8-a57fec2400f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vknhj\" (UniqueName: \"kubernetes.io/projected/c14eb7e6-5870-4784-8ec8-a57fec2400f0-kube-api-access-vknhj\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618615 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14eb7e6-5870-4784-8ec8-a57fec2400f0-config-out\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618636 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618663 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618702 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.618730 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618730 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14eb7e6-5870-4784-8ec8-a57fec2400f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.619130 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618764 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14eb7e6-5870-4784-8ec8-a57fec2400f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.619130 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.618791 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.619130 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.619064 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14eb7e6-5870-4784-8ec8-a57fec2400f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.619482 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.619456 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14eb7e6-5870-4784-8ec8-a57fec2400f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.620015 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.619976 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14eb7e6-5870-4784-8ec8-a57fec2400f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.621699 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.621672 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.621803 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.621770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.621864 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.621817 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-web-config\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.622171 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.622146 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.622255 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.622186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14eb7e6-5870-4784-8ec8-a57fec2400f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.622433 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.622411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.622881 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.622859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.622982 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.622882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14eb7e6-5870-4784-8ec8-a57fec2400f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.623039 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.623023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14eb7e6-5870-4784-8ec8-a57fec2400f0-config-out\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.627152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.627128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknhj\" (UniqueName: \"kubernetes.io/projected/c14eb7e6-5870-4784-8ec8-a57fec2400f0-kube-api-access-vknhj\") pod \"alertmanager-main-0\" (UID: \"c14eb7e6-5870-4784-8ec8-a57fec2400f0\") " pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.780823 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.780790 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 19:34:30.853814 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.853782 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a78a18-c3a7-416f-b50c-4345b4cd7089" path="/var/lib/kubelet/pods/69a78a18-c3a7-416f-b50c-4345b4cd7089/volumes" May 27 19:34:30.915700 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:30.915678 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 19:34:30.917713 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:34:30.917686 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14eb7e6_5870_4784_8ec8_a57fec2400f0.slice/crio-3d93732a43e48b570051066a888066274fbbb39df3430f7a6c7c2bfd5ec1150a WatchSource:0}: Error finding container 3d93732a43e48b570051066a888066274fbbb39df3430f7a6c7c2bfd5ec1150a: Status 404 returned error can't find the container with id 3d93732a43e48b570051066a888066274fbbb39df3430f7a6c7c2bfd5ec1150a May 27 19:34:31.389022 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:31.388987 2565 generic.go:358] "Generic (PLEG): container finished" podID="c14eb7e6-5870-4784-8ec8-a57fec2400f0" containerID="272ef37aa372c81a84ab9ae038b37495115724947fed0284dde23ffb8ee891a0" exitCode=0 May 27 19:34:31.389380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:31.389039 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerDied","Data":"272ef37aa372c81a84ab9ae038b37495115724947fed0284dde23ffb8ee891a0"} May 27 19:34:31.389380 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:31.389060 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"3d93732a43e48b570051066a888066274fbbb39df3430f7a6c7c2bfd5ec1150a"} May 27 19:34:32.395516 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.395479 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"496bf6c1e8c692db4eb3916acac30f14cfdf1f3eae76fc749d3f9b81f755e070"} May 27 19:34:32.395516 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.395519 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"7d2584952cf3328d12b39eb05f990036975343c3026705f718a89be85c09670a"} May 27 19:34:32.396104 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.395529 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"d4f8b30512007b26e618610ac0db62fbb3039f23f8cd2b56c0ffa47f40a80605"} May 27 19:34:32.396104 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.395538 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"35b0f68ca2d5f50c17fe604f2b159e53253aee76d823a3bf80b7a4965c5552bf"} May 27 19:34:32.396104 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.395546 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"4c9eb650b3880eb0d57a96b1f46814299d641f3f77e35bbb312771645ed4f185"} May 27 19:34:32.396104 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.395554 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14eb7e6-5870-4784-8ec8-a57fec2400f0","Type":"ContainerStarted","Data":"75a0af314fde56ca8d22e4943654da824e8f7d05212da6cce97b2fb0eb104341"} May 27 19:34:32.424237 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.424193 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.424179188 podStartE2EDuration="2.424179188s" podCreationTimestamp="2026-05-27 19:34:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:34:32.423057125 +0000 UTC m=+116.201584502" watchObservedRunningTime="2026-05-27 19:34:32.424179188 +0000 UTC m=+116.202706559" May 27 19:34:32.454536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.454501 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:34:32.455388 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.455355 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="prometheus" containerID="cri-o://81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" gracePeriod=600 May 27 19:34:32.455673 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.455644 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-web" containerID="cri-o://ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" gracePeriod=600 May 27 19:34:32.455781 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.455677 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy" containerID="cri-o://a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" gracePeriod=600 May 27 19:34:32.455781 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.455680 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="config-reloader" containerID="cri-o://d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" gracePeriod=600 May 27 19:34:32.455781 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.455777 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="thanos-sidecar" containerID="cri-o://0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" gracePeriod=600 May 27 19:34:32.455977 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.455823 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" gracePeriod=600 May 27 19:34:32.723308 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.723284 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:32.839968 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.839932 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-kubelet-serving-ca-bundle\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.839968 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.839965 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-rulefiles-0\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.839984 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-kube-rbac-proxy\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840007 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-thanos-prometheus-http-client-file\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840027 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-metrics-client-certs\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840059 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-db\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840082 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840103 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-tls-assets\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840158 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-web-config\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840181 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-metrics-client-ca\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840216 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840203 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config-out\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840237 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj22r\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-kube-api-access-vj22r\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840283 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-trusted-ca-bundle\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840307 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840307 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840346 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-serving-certs-ca-bundle\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840372 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840400 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-tls\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.840676 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840438 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-grpc-tls\") pod \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\" (UID: \"46fb657e-f6a8-43e2-8ff8-c44840eedfca\") " May 27 19:34:32.841095 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.840739 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.841741 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.841162 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:34:32.841863 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.841766 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:32.842457 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.842432 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:32.842727 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.842693 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.842816 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.842751 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.842816 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.842794 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.842971 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.842834 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config-out" (OuterVolumeSpecName: "config-out") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:34:32.843061 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.843033 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.843295 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.843271 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:32.843728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.843667 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.843728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.843715 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:34:32.844812 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.844788 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.844937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.844889 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:34:32.845139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.845108 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.845225 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.845198 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-kube-api-access-vj22r" (OuterVolumeSpecName: "kube-api-access-vj22r") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "kube-api-access-vj22r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:34:32.845366 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.845347 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config" (OuterVolumeSpecName: "config") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.854241 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.854218 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-web-config" (OuterVolumeSpecName: "web-config") pod "46fb657e-f6a8-43e2-8ff8-c44840eedfca" (UID: "46fb657e-f6a8-43e2-8ff8-c44840eedfca"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:34:32.942063 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942037 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-tls-assets\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942063 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942063 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-web-config\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942073 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-metrics-client-ca\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942082 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config-out\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942091 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj22r\" (UniqueName: \"kubernetes.io/projected/46fb657e-f6a8-43e2-8ff8-c44840eedfca-kube-api-access-vj22r\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942101 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942110 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-config\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942120 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942130 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942139 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942148 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-grpc-tls\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942156 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942164 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-kube-rbac-proxy\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942173 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942184 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-metrics-client-certs\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942193 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46fb657e-f6a8-43e2-8ff8-c44840eedfca-prometheus-k8s-db\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:32.942224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:32.942201 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46fb657e-f6a8-43e2-8ff8-c44840eedfca-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:34:33.402046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402012 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" exitCode=0 May 27 19:34:33.402046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402039 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" exitCode=0 May 27 19:34:33.402046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402045 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" exitCode=0 May 27 19:34:33.402046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402050 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" exitCode=0 May 27 19:34:33.402046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402056 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" exitCode=0 May 27 19:34:33.402046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402061 2565 generic.go:358] "Generic (PLEG): container finished" podID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" exitCode=0 May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402096 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402122 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402135 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402146 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402156 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402165 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402175 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402184 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46fb657e-f6a8-43e2-8ff8-c44840eedfca","Type":"ContainerDied","Data":"6eb3daabb1911d8f012d6ab2e1ebb5d0a7b9b139e2b8cc580a8c4eac5c168734"} May 27 19:34:33.402728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.402198 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.410324 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.410232 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.420401 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.420384 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.427419 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.427362 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.428269 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.428197 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:34:33.431312 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.431292 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:34:33.434452 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.434436 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.440975 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.440961 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.447614 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.447597 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.453978 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.453961 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.454236 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.454211 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.454313 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.454243 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} err="failed to get container status \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" May 27 19:34:33.454313 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.454278 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.454514 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.454498 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.454555 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.454520 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} err="failed to get container status \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" May 27 19:34:33.454555 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.454536 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.454762 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.454745 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.454801 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.454767 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} err="failed to get container status \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" May 27 19:34:33.454801 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.454782 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.455015 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.454998 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.455068 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455019 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} err="failed to get container status \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" May 27 19:34:33.455068 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455033 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.455248 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.455228 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.455288 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455253 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} err="failed to get container status \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" May 27 19:34:33.455288 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455266 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.455464 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.455447 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.455499 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455475 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} err="failed to get container status \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" May 27 19:34:33.455499 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455490 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.455716 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:34:33.455693 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.455748 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455729 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} err="failed to get container status \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" May 27 19:34:33.455748 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455744 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.455948 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455929 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} err="failed to get container status \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" May 27 19:34:33.455988 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.455948 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.456156 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456136 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} err="failed to get container status \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" May 27 19:34:33.456233 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456158 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.456379 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456361 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} err="failed to get container status \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" May 27 19:34:33.456440 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456380 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.456569 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456549 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} err="failed to get container status \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" May 27 19:34:33.456610 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456569 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.456778 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456761 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} err="failed to get container status \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" May 27 19:34:33.456858 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456780 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.457011 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.456995 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} err="failed to get container status \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" May 27 19:34:33.457079 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457013 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.457231 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457214 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} err="failed to get container status \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" May 27 19:34:33.457272 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457232 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.457430 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457412 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} err="failed to get container status \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" May 27 19:34:33.457470 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457431 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.457641 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457621 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} err="failed to get container status \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" May 27 19:34:33.457683 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457642 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.457847 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457818 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} err="failed to get container status \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" May 27 19:34:33.457928 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.457850 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.458093 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458077 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} err="failed to get container status \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" May 27 19:34:33.458152 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458095 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.458295 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458278 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} err="failed to get container status \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" May 27 19:34:33.458352 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458296 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.458515 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458497 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} err="failed to get container status \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" May 27 19:34:33.458564 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458516 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.458719 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458702 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} err="failed to get container status \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" May 27 19:34:33.458782 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458720 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.458940 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458923 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} err="failed to get container status \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" May 27 19:34:33.458986 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.458942 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.459140 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459123 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} err="failed to get container status \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" May 27 19:34:33.459191 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459141 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.459341 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459324 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} err="failed to get container status \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" May 27 19:34:33.459404 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459342 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.459529 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459514 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} err="failed to get container status \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" May 27 19:34:33.459585 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459531 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.459729 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459707 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} err="failed to get container status \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" May 27 19:34:33.459814 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459738 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.460013 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.459989 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} err="failed to get container status \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" May 27 19:34:33.460064 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460017 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.460357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460330 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} err="failed to get container status \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" May 27 19:34:33.460357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460357 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.460683 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460571 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} err="failed to get container status \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" May 27 19:34:33.460683 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460589 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.461020 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460863 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} err="failed to get container status \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" May 27 19:34:33.461117 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.460971 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.461304 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.461279 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} err="failed to get container status \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" May 27 19:34:33.461406 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.461306 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.461582 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.461560 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} err="failed to get container status \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" May 27 19:34:33.461582 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.461581 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.462162 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} err="failed to get container status \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.462202 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.463488 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} err="failed to get container status \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.463517 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.463981 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} err="failed to get container status \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.464011 2565 scope.go:117] "RemoveContainer" containerID="5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.464342 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64"} err="failed to get container status \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": rpc error: code = NotFound desc = could not find container \"5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64\": container with ID starting with 5f33c937be7151fed8ccfaa755bd1fcbd55f003f7ee4beed7da090ec4279be64 not found: ID does not exist" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.464365 2565 scope.go:117] "RemoveContainer" containerID="a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.464408 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.464837 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7"} err="failed to get container status \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": rpc error: code = NotFound desc = could not find container \"a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7\": container with ID starting with a2bb3ce776249601fc96e8cff293a467e37ccf07adb355d633e41539381f10b7 not found: ID does not exist" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.464872 2565 scope.go:117] "RemoveContainer" containerID="ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465127 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a"} err="failed to get container status \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": rpc error: code = NotFound desc = could not find container \"ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a\": container with ID starting with ef0b4f6990f36a576e9ecb1e1128a30b4e9f4603217744f1324f5718f95bfe1a not found: ID does not exist" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465158 2565 scope.go:117] "RemoveContainer" containerID="0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465199 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="thanos-sidecar" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465217 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="thanos-sidecar" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465245 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="prometheus" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465254 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="prometheus" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465317 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465327 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465346 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-thanos" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465354 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-thanos" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465369 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-web" May 27 19:34:33.468230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465384 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-web" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465397 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="init-config-reloader" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465405 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="init-config-reloader" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465452 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="config-reloader" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465461 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="config-reloader" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465477 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a"} err="failed to get container status \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": rpc error: code = NotFound desc = could not find container \"0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a\": container with ID starting with 0cf4afed85f5ae4f0e394593b709c8f1b18ce1e022c6a54e397fdfefbc057d9a not found: ID does not exist" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465499 2565 scope.go:117] "RemoveContainer" containerID="d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465597 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="prometheus" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465614 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="config-reloader" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465624 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465641 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-web" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465652 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="kube-rbac-proxy-thanos" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465669 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" containerName="thanos-sidecar" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465811 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9"} err="failed to get container status \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": rpc error: code = NotFound desc = could not find container \"d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9\": container with ID starting with d645eaf9065d685bb9331f43c0dccc4d5d56fcb40061345c84c11e388465d0f9 not found: ID does not exist" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.465829 2565 scope.go:117] "RemoveContainer" containerID="81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.466102 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817"} err="failed to get container status \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": rpc error: code = NotFound desc = could not find container \"81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817\": container with ID starting with 81a4595014ca741af45798d0e4b521dd2a86befe9e4f0600c55bd1529ced5817 not found: ID does not exist" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.466127 2565 scope.go:117] "RemoveContainer" containerID="0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9" May 27 19:34:33.469096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.466425 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9"} err="failed to get container status \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": rpc error: code = NotFound desc = could not find container \"0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9\": container with ID starting with 0f4879031fc5a67c0290adecc2ecc3305694b74431d06df42cc80fbea6716af9 not found: ID does not exist" May 27 19:34:33.507249 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.507217 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:34:33.507406 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.507358 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.510404 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510376 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 19:34:33.510404 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510393 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 19:34:33.510564 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510523 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 19:34:33.510776 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510760 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-edav3r7dki9ne\"" May 27 19:34:33.510826 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510811 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 19:34:33.510998 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510965 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 19:34:33.510998 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.510974 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 19:34:33.511163 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.511142 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 19:34:33.511528 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.511501 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 19:34:33.511625 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.511529 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d4w66\"" May 27 19:34:33.511625 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.511605 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 19:34:33.511728 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.511627 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 19:34:33.514816 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.514700 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 19:34:33.516822 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.516803 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 19:34:33.648868 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.648795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.648868 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.648830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.648868 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.648853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.648956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e4046f5-cb2d-4138-9386-e021587d1650-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrhl\" (UniqueName: \"kubernetes.io/projected/6e4046f5-cb2d-4138-9386-e021587d1650-kube-api-access-zqrhl\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649375 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649375 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649375 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649375 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e4046f5-cb2d-4138-9386-e021587d1650-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649375 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649375 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649605 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-config\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649605 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.649605 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.649440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750035 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750004 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750035 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e4046f5-cb2d-4138-9386-e021587d1650-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750085 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750109 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750127 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-config\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750152 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750167 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750191 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750220 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750248 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750282 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750275 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750310 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e4046f5-cb2d-4138-9386-e021587d1650-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750337 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750361 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750392 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750417 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrhl\" (UniqueName: \"kubernetes.io/projected/6e4046f5-cb2d-4138-9386-e021587d1650-kube-api-access-zqrhl\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.750794 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.750479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.751106 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.751006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.751235 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.751209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.751502 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.751474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.752069 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.752022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.753265 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.753093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e4046f5-cb2d-4138-9386-e021587d1650-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.753265 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.753244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.753429 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.753259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-config\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.753573 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.753547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e4046f5-cb2d-4138-9386-e021587d1650-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.753767 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.753744 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.753848 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.751221 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.754552 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.754530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.755431 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.755405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.755593 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.755561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.755691 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.755633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e4046f5-cb2d-4138-9386-e021587d1650-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.755855 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.755836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.756051 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.756030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.756777 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.756761 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e4046f5-cb2d-4138-9386-e021587d1650-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.761085 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.761070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrhl\" (UniqueName: \"kubernetes.io/projected/6e4046f5-cb2d-4138-9386-e021587d1650-kube-api-access-zqrhl\") pod \"prometheus-k8s-0\" (UID: \"6e4046f5-cb2d-4138-9386-e021587d1650\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.817713 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.817688 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:33.952126 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:33.952104 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 19:34:33.953761 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:34:33.953736 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4046f5_cb2d_4138_9386_e021587d1650.slice/crio-6e0166981dfe1048650d934c4a4f3b8a1a3f9947c7d5e8537d730613c02525a5 WatchSource:0}: Error finding container 6e0166981dfe1048650d934c4a4f3b8a1a3f9947c7d5e8537d730613c02525a5: Status 404 returned error can't find the container with id 6e0166981dfe1048650d934c4a4f3b8a1a3f9947c7d5e8537d730613c02525a5 May 27 19:34:34.410630 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:34.410548 2565 generic.go:358] "Generic (PLEG): container finished" podID="6e4046f5-cb2d-4138-9386-e021587d1650" containerID="53341e357e1c45e3d658786177ea1aef370091d482b4987c6022612ae0deec94" exitCode=0 May 27 19:34:34.411069 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:34.410642 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerDied","Data":"53341e357e1c45e3d658786177ea1aef370091d482b4987c6022612ae0deec94"} May 27 19:34:34.411069 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:34.410685 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"6e0166981dfe1048650d934c4a4f3b8a1a3f9947c7d5e8537d730613c02525a5"} May 27 19:34:34.860569 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:34.860228 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fb657e-f6a8-43e2-8ff8-c44840eedfca" path="/var/lib/kubelet/pods/46fb657e-f6a8-43e2-8ff8-c44840eedfca/volumes" May 27 19:34:35.417398 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.417367 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"04ae0c335ee3d8d18a46e7896061a399adbe4768f6cfb737bc3e32bc8e8f9265"} May 27 19:34:35.417398 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.417403 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"04ef9a7e55388d978b8c444965b499a649331dfca42ef7560623f38d1fa96f5e"} May 27 19:34:35.417778 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.417413 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"cb2fd2bb873cfb6b4c633762b95fc7a96313d92c2ccd761278d2536fe7e7c684"} May 27 19:34:35.417778 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.417422 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"553f299d3a7d8ac5f9a506d535c4ab60030b510510e359533d67c8db33fd4d48"} May 27 19:34:35.417778 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.417431 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"5b1113d226d5fea1092098a113d28d980f50170f6d9a1a6c8e25a159a730769d"} May 27 19:34:35.417778 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.417440 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4046f5-cb2d-4138-9386-e021587d1650","Type":"ContainerStarted","Data":"c547aca9417397be27905cc231018c0fa400d371a5ddf76d3387c4aa9a21c3ad"} May 27 19:34:35.450201 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:35.450154 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.450136654 podStartE2EDuration="2.450136654s" podCreationTimestamp="2026-05-27 19:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:34:35.448256314 +0000 UTC m=+119.226783696" watchObservedRunningTime="2026-05-27 19:34:35.450136654 +0000 UTC m=+119.228664027" May 27 19:34:38.817967 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:38.817897 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:34:53.927020 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:53.926987 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-h7zhs"] May 27 19:34:53.930093 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:53.930074 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:53.932520 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:53.932500 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 19:34:53.937777 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:53.937747 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7zhs"] May 27 19:34:54.030858 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.030815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a70f2617-ebb8-4259-b2fe-2ec67d920efb-dbus\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.031047 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.030895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a70f2617-ebb8-4259-b2fe-2ec67d920efb-kubelet-config\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.031047 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.030953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a70f2617-ebb8-4259-b2fe-2ec67d920efb-original-pull-secret\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.132009 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.131979 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a70f2617-ebb8-4259-b2fe-2ec67d920efb-dbus\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.132168 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.132066 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a70f2617-ebb8-4259-b2fe-2ec67d920efb-kubelet-config\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.132168 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.132096 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a70f2617-ebb8-4259-b2fe-2ec67d920efb-original-pull-secret\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.132168 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.132148 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a70f2617-ebb8-4259-b2fe-2ec67d920efb-dbus\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.132318 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.132176 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a70f2617-ebb8-4259-b2fe-2ec67d920efb-kubelet-config\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.134219 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.134196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a70f2617-ebb8-4259-b2fe-2ec67d920efb-original-pull-secret\") pod \"global-pull-secret-syncer-h7zhs\" (UID: \"a70f2617-ebb8-4259-b2fe-2ec67d920efb\") " pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.239656 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.239613 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7zhs" May 27 19:34:54.363419 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.363341 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7zhs"] May 27 19:34:54.365660 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:34:54.365634 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70f2617_ebb8_4259_b2fe_2ec67d920efb.slice/crio-d2ba1d641ac5110008273b0ab1000a6e94a1a6675cc644e0da3933ce4746175f WatchSource:0}: Error finding container d2ba1d641ac5110008273b0ab1000a6e94a1a6675cc644e0da3933ce4746175f: Status 404 returned error can't find the container with id d2ba1d641ac5110008273b0ab1000a6e94a1a6675cc644e0da3933ce4746175f May 27 19:34:54.479089 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:54.479057 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7zhs" event={"ID":"a70f2617-ebb8-4259-b2fe-2ec67d920efb","Type":"ContainerStarted","Data":"d2ba1d641ac5110008273b0ab1000a6e94a1a6675cc644e0da3933ce4746175f"} May 27 19:34:58.493298 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:58.493256 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7zhs" event={"ID":"a70f2617-ebb8-4259-b2fe-2ec67d920efb","Type":"ContainerStarted","Data":"cdafe1dce6944743e3cecbd2b139b03d1100cc202006d75a949fdfb657c73e86"} May 27 19:34:58.509681 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:34:58.509640 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h7zhs" podStartSLOduration=1.851549457 podStartE2EDuration="5.50962496s" podCreationTimestamp="2026-05-27 19:34:53 +0000 UTC" firstStartedPulling="2026-05-27 19:34:54.367325164 +0000 UTC m=+138.145852514" lastFinishedPulling="2026-05-27 19:34:58.025400665 +0000 UTC m=+141.803928017" observedRunningTime="2026-05-27 19:34:58.509237597 +0000 UTC m=+142.287764970" watchObservedRunningTime="2026-05-27 19:34:58.50962496 +0000 UTC m=+142.288152335" May 27 19:35:33.818497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:33.818407 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:35:33.833742 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:33.833717 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:35:34.616773 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:34.616743 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 19:35:47.754742 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.754706 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c"] May 27 19:35:47.758764 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.758745 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:47.762495 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.762474 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 19:35:47.762581 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.762499 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 19:35:47.763405 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.763386 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7dvz2\"" May 27 19:35:47.773787 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.773766 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c"] May 27 19:35:47.792811 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.792789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5ca5b3-1e60-40c8-9a7e-a95481072c47-tmp\") pod \"openshift-lws-operator-bfc7f696d-m2m2c\" (UID: \"4a5ca5b3-1e60-40c8-9a7e-a95481072c47\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:47.792926 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.792818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z47t\" (UniqueName: \"kubernetes.io/projected/4a5ca5b3-1e60-40c8-9a7e-a95481072c47-kube-api-access-4z47t\") pod \"openshift-lws-operator-bfc7f696d-m2m2c\" (UID: \"4a5ca5b3-1e60-40c8-9a7e-a95481072c47\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:47.894096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.894053 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5ca5b3-1e60-40c8-9a7e-a95481072c47-tmp\") pod \"openshift-lws-operator-bfc7f696d-m2m2c\" (UID: \"4a5ca5b3-1e60-40c8-9a7e-a95481072c47\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:47.894096 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.894099 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4z47t\" (UniqueName: \"kubernetes.io/projected/4a5ca5b3-1e60-40c8-9a7e-a95481072c47-kube-api-access-4z47t\") pod \"openshift-lws-operator-bfc7f696d-m2m2c\" (UID: \"4a5ca5b3-1e60-40c8-9a7e-a95481072c47\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:47.894418 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.894398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5ca5b3-1e60-40c8-9a7e-a95481072c47-tmp\") pod \"openshift-lws-operator-bfc7f696d-m2m2c\" (UID: \"4a5ca5b3-1e60-40c8-9a7e-a95481072c47\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:47.903253 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:47.903224 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z47t\" (UniqueName: \"kubernetes.io/projected/4a5ca5b3-1e60-40c8-9a7e-a95481072c47-kube-api-access-4z47t\") pod \"openshift-lws-operator-bfc7f696d-m2m2c\" (UID: \"4a5ca5b3-1e60-40c8-9a7e-a95481072c47\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:48.081800 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:48.081711 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" May 27 19:35:48.214858 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:48.214823 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c"] May 27 19:35:48.217962 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:35:48.217936 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a5ca5b3_1e60_40c8_9a7e_a95481072c47.slice/crio-63ae4045d0c565e8caf80b0b1518a6cda02fd055724f8120c91f57bdcc0e9895 WatchSource:0}: Error finding container 63ae4045d0c565e8caf80b0b1518a6cda02fd055724f8120c91f57bdcc0e9895: Status 404 returned error can't find the container with id 63ae4045d0c565e8caf80b0b1518a6cda02fd055724f8120c91f57bdcc0e9895 May 27 19:35:48.647210 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:48.647178 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" event={"ID":"4a5ca5b3-1e60-40c8-9a7e-a95481072c47","Type":"ContainerStarted","Data":"63ae4045d0c565e8caf80b0b1518a6cda02fd055724f8120c91f57bdcc0e9895"} May 27 19:35:51.659798 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:51.659755 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" event={"ID":"4a5ca5b3-1e60-40c8-9a7e-a95481072c47","Type":"ContainerStarted","Data":"246b577e3f3d837c9aa6a69780d4f2d91b6ccdc1c03d4ae6c53e57bc70044344"} May 27 19:35:51.677564 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:35:51.677520 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m2m2c" podStartSLOduration=2.168284803 podStartE2EDuration="4.677506082s" podCreationTimestamp="2026-05-27 19:35:47 +0000 UTC" firstStartedPulling="2026-05-27 19:35:48.219352298 +0000 UTC m=+191.997879647" lastFinishedPulling="2026-05-27 19:35:50.728573565 +0000 UTC m=+194.507100926" observedRunningTime="2026-05-27 19:35:51.676972235 +0000 UTC m=+195.455499608" watchObservedRunningTime="2026-05-27 19:35:51.677506082 +0000 UTC m=+195.456033453" May 27 19:36:07.869165 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.869130 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h"] May 27 19:36:07.872538 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.872519 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:07.875289 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.875266 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 19:36:07.875406 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.875360 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 19:36:07.875469 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.875298 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 19:36:07.875469 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.875285 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 19:36:07.875963 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.875947 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kwr6d\"" May 27 19:36:07.891080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.891054 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h"] May 27 19:36:07.972786 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.972742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad960697-af6d-45b7-8c01-c98f6cb19ff8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:07.973034 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.972794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5sm9\" (UniqueName: \"kubernetes.io/projected/ad960697-af6d-45b7-8c01-c98f6cb19ff8-kube-api-access-w5sm9\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:07.973034 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:07.973008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad960697-af6d-45b7-8c01-c98f6cb19ff8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.074520 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.074474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad960697-af6d-45b7-8c01-c98f6cb19ff8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.074520 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.074521 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5sm9\" (UniqueName: \"kubernetes.io/projected/ad960697-af6d-45b7-8c01-c98f6cb19ff8-kube-api-access-w5sm9\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.074717 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.074558 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad960697-af6d-45b7-8c01-c98f6cb19ff8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.076945 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.076926 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad960697-af6d-45b7-8c01-c98f6cb19ff8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.077071 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.077050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad960697-af6d-45b7-8c01-c98f6cb19ff8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.083229 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.083200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5sm9\" (UniqueName: \"kubernetes.io/projected/ad960697-af6d-45b7-8c01-c98f6cb19ff8-kube-api-access-w5sm9\") pod \"opendatahub-operator-controller-manager-6f485759dc-6px9h\" (UID: \"ad960697-af6d-45b7-8c01-c98f6cb19ff8\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.183402 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.183318 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:08.318253 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.318229 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h"] May 27 19:36:08.320642 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:36:08.320609 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad960697_af6d_45b7_8c01_c98f6cb19ff8.slice/crio-4bdb305b96aae9426a931add9ec4b5d1958ae46beb0f41f2d1d9d5f769b1878c WatchSource:0}: Error finding container 4bdb305b96aae9426a931add9ec4b5d1958ae46beb0f41f2d1d9d5f769b1878c: Status 404 returned error can't find the container with id 4bdb305b96aae9426a931add9ec4b5d1958ae46beb0f41f2d1d9d5f769b1878c May 27 19:36:08.722581 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:08.722537 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" event={"ID":"ad960697-af6d-45b7-8c01-c98f6cb19ff8","Type":"ContainerStarted","Data":"4bdb305b96aae9426a931add9ec4b5d1958ae46beb0f41f2d1d9d5f769b1878c"} May 27 19:36:11.736092 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:11.736059 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" event={"ID":"ad960697-af6d-45b7-8c01-c98f6cb19ff8","Type":"ContainerStarted","Data":"45361ff2ed8f37b92ae32abf279ff4b6647c3dd4de2a453cb36ace9b749b5b3e"} May 27 19:36:11.736470 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:11.736145 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:11.759582 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:11.759534 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" podStartSLOduration=2.288014765 podStartE2EDuration="4.759518593s" podCreationTimestamp="2026-05-27 19:36:07 +0000 UTC" firstStartedPulling="2026-05-27 19:36:08.32243212 +0000 UTC m=+212.100959471" lastFinishedPulling="2026-05-27 19:36:10.793935949 +0000 UTC m=+214.572463299" observedRunningTime="2026-05-27 19:36:11.757735659 +0000 UTC m=+215.536263027" watchObservedRunningTime="2026-05-27 19:36:11.759518593 +0000 UTC m=+215.538046026" May 27 19:36:22.742290 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:22.742259 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-6px9h" May 27 19:36:23.053031 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.052952 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk"] May 27 19:36:23.059711 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.059688 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.062983 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.062960 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jncxq\"" May 27 19:36:23.062983 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.062975 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 19:36:23.063168 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.063037 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 19:36:23.063168 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.063081 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 19:36:23.071878 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.071857 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk"] May 27 19:36:23.204820 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.204788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60d3aef6-6526-400c-a568-273da9b7843b-cert\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.205003 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.204826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/60d3aef6-6526-400c-a568-273da9b7843b-metrics-cert\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.205047 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.205007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/60d3aef6-6526-400c-a568-273da9b7843b-manager-config\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.205079 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.205047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx56r\" (UniqueName: \"kubernetes.io/projected/60d3aef6-6526-400c-a568-273da9b7843b-kube-api-access-lx56r\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.305799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.305721 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/60d3aef6-6526-400c-a568-273da9b7843b-manager-config\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.305799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.305757 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx56r\" (UniqueName: \"kubernetes.io/projected/60d3aef6-6526-400c-a568-273da9b7843b-kube-api-access-lx56r\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.305799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.305783 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60d3aef6-6526-400c-a568-273da9b7843b-cert\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.305799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.305801 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/60d3aef6-6526-400c-a568-273da9b7843b-metrics-cert\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.306444 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.306421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/60d3aef6-6526-400c-a568-273da9b7843b-manager-config\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.308361 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.308338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/60d3aef6-6526-400c-a568-273da9b7843b-metrics-cert\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.308361 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.308363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60d3aef6-6526-400c-a568-273da9b7843b-cert\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.319264 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.319245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx56r\" (UniqueName: \"kubernetes.io/projected/60d3aef6-6526-400c-a568-273da9b7843b-kube-api-access-lx56r\") pod \"lws-controller-manager-8459f94865-q6nsk\" (UID: \"60d3aef6-6526-400c-a568-273da9b7843b\") " pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.368861 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.368836 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:23.497802 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.497778 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk"] May 27 19:36:23.500204 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:36:23.500178 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d3aef6_6526_400c_a568_273da9b7843b.slice/crio-16ecb158e9f84154cef0327c82e1820006a74b422634d59edcf7007886ba6ae6 WatchSource:0}: Error finding container 16ecb158e9f84154cef0327c82e1820006a74b422634d59edcf7007886ba6ae6: Status 404 returned error can't find the container with id 16ecb158e9f84154cef0327c82e1820006a74b422634d59edcf7007886ba6ae6 May 27 19:36:23.774657 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:23.774624 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" event={"ID":"60d3aef6-6526-400c-a568-273da9b7843b","Type":"ContainerStarted","Data":"16ecb158e9f84154cef0327c82e1820006a74b422634d59edcf7007886ba6ae6"} May 27 19:36:25.783298 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:25.783262 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" event={"ID":"60d3aef6-6526-400c-a568-273da9b7843b","Type":"ContainerStarted","Data":"a16d2e5ed5b7fadd6cf71e975106ef83b76aa3b8c6aced5507c70559e11fa061"} May 27 19:36:25.783773 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:25.783311 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:25.803128 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:25.803067 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" podStartSLOduration=0.925845962 podStartE2EDuration="2.803051325s" podCreationTimestamp="2026-05-27 19:36:23 +0000 UTC" firstStartedPulling="2026-05-27 19:36:23.502007651 +0000 UTC m=+227.280535004" lastFinishedPulling="2026-05-27 19:36:25.379213016 +0000 UTC m=+229.157740367" observedRunningTime="2026-05-27 19:36:25.802826229 +0000 UTC m=+229.581353601" watchObservedRunningTime="2026-05-27 19:36:25.803051325 +0000 UTC m=+229.581578764" May 27 19:36:36.675431 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.675389 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7"] May 27 19:36:36.684087 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.684066 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.687169 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.687092 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 19:36:36.687403 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.687367 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 19:36:36.688640 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.688615 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 19:36:36.688752 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.688645 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pnwpd\"" May 27 19:36:36.688752 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.688667 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 19:36:36.690174 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.690153 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7"] May 27 19:36:36.720436 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.720405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.720547 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.720499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tmp\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.720547 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.720538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxnr\" (UniqueName: \"kubernetes.io/projected/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-kube-api-access-vjxnr\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.788673 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.788647 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8459f94865-q6nsk" May 27 19:36:36.821156 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.821127 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tmp\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.821315 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.821164 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxnr\" (UniqueName: \"kubernetes.io/projected/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-kube-api-access-vjxnr\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.821315 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.821282 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.823400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.823375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tmp\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:36.823736 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.823714 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 19:36:36.831860 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:36:36.831473 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 27 19:36:36.831860 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:36:36.831569 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tls-certs podName:96c161b6-a6a6-4d8a-9fbb-90376fe180e2 nodeName:}" failed. No retries permitted until 2026-05-27 19:36:37.331548935 +0000 UTC m=+241.110076297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tls-certs") pod "kube-auth-proxy-6c44b8656c-kx5x7" (UID: "96c161b6-a6a6-4d8a-9fbb-90376fe180e2") : secret "kube-auth-proxy-tls" not found May 27 19:36:36.832878 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.832852 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 19:36:36.844743 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.844721 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 19:36:36.853956 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:36.853933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxnr\" (UniqueName: \"kubernetes.io/projected/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-kube-api-access-vjxnr\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:37.427919 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:37.427865 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:37.430235 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:37.430214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96c161b6-a6a6-4d8a-9fbb-90376fe180e2-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-kx5x7\" (UID: \"96c161b6-a6a6-4d8a-9fbb-90376fe180e2\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:37.599706 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:37.599675 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pnwpd\"" May 27 19:36:37.607139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:37.607109 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" May 27 19:36:37.731890 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:37.731862 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7"] May 27 19:36:37.734835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:36:37.734801 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c161b6_a6a6_4d8a_9fbb_90376fe180e2.slice/crio-3f2ca22b47005a6bcd0109ff8c6ed52fcb88df854d6a5f8ceb67fddb9faca81e WatchSource:0}: Error finding container 3f2ca22b47005a6bcd0109ff8c6ed52fcb88df854d6a5f8ceb67fddb9faca81e: Status 404 returned error can't find the container with id 3f2ca22b47005a6bcd0109ff8c6ed52fcb88df854d6a5f8ceb67fddb9faca81e May 27 19:36:37.824745 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:37.824704 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" event={"ID":"96c161b6-a6a6-4d8a-9fbb-90376fe180e2","Type":"ContainerStarted","Data":"3f2ca22b47005a6bcd0109ff8c6ed52fcb88df854d6a5f8ceb67fddb9faca81e"} May 27 19:36:41.334139 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:41.334115 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 19:36:41.840751 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:41.840712 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" event={"ID":"96c161b6-a6a6-4d8a-9fbb-90376fe180e2","Type":"ContainerStarted","Data":"4a17de1063b3b344624ec05ffee8e4b0fe6ad7e04003b46319f60d15dae269b6"} May 27 19:36:41.864714 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:36:41.864665 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-kx5x7" podStartSLOduration=2.269976329 podStartE2EDuration="5.864652625s" podCreationTimestamp="2026-05-27 19:36:36 +0000 UTC" firstStartedPulling="2026-05-27 19:36:37.736577239 +0000 UTC m=+241.515104590" lastFinishedPulling="2026-05-27 19:36:41.331253536 +0000 UTC m=+245.109780886" observedRunningTime="2026-05-27 19:36:41.864038162 +0000 UTC m=+245.642565537" watchObservedRunningTime="2026-05-27 19:36:41.864652625 +0000 UTC m=+245.643179995" May 27 19:37:36.746421 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:37:36.746391 2565 kubelet.go:1628] "Image garbage collection succeeded" May 27 19:38:18.697062 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.697033 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8"] May 27 19:38:18.700301 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.700285 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.703076 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.703055 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 19:38:18.703224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.703093 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 27 19:38:18.703224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.703148 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 19:38:18.704088 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.704070 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 27 19:38:18.704178 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.704103 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xvkj4\"" May 27 19:38:18.711939 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.711897 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8"] May 27 19:38:18.740417 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.740375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbgk\" (UniqueName: \"kubernetes.io/projected/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-kube-api-access-wtbgk\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.740590 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.740555 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.740648 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.740586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.841702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.841674 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.841862 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.841709 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.841862 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.841745 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbgk\" (UniqueName: \"kubernetes.io/projected/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-kube-api-access-wtbgk\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.841862 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:38:18.841820 2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 27 19:38:18.842049 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:38:18.841886 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-plugin-serving-cert podName:1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c nodeName:}" failed. No retries permitted until 2026-05-27 19:38:19.341868039 +0000 UTC m=+343.120395394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-b7sj8" (UID: "1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c") : secret "plugin-serving-cert" not found May 27 19:38:18.842420 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.842395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:18.851356 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:18.851329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbgk\" (UniqueName: \"kubernetes.io/projected/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-kube-api-access-wtbgk\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:19.346924 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:19.346862 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:19.349233 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:19.349207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b7sj8\" (UID: \"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:19.610033 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:19.609960 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" May 27 19:38:19.750968 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:19.750852 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8"] May 27 19:38:19.753217 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:38:19.753183 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ef658e7_ba0e_42c8_a2a6_639cbbc6a10c.slice/crio-31a78f114ebb2ced5ce1066bc1deb5cde0a185f8fb5adfd69649385c43d867ff WatchSource:0}: Error finding container 31a78f114ebb2ced5ce1066bc1deb5cde0a185f8fb5adfd69649385c43d867ff: Status 404 returned error can't find the container with id 31a78f114ebb2ced5ce1066bc1deb5cde0a185f8fb5adfd69649385c43d867ff May 27 19:38:19.754359 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:19.754330 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:38:20.179640 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:20.179606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" event={"ID":"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c","Type":"ContainerStarted","Data":"31a78f114ebb2ced5ce1066bc1deb5cde0a185f8fb5adfd69649385c43d867ff"} May 27 19:38:29.009528 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.009434 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr"] May 27 19:38:29.019414 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.019390 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.027616 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.027543 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkmg8\"" May 27 19:38:29.027760 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.027614 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr"] May 27 19:38:29.137497 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.137461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5985\" (UniqueName: \"kubernetes.io/projected/98aff4f4-b527-421b-a36c-f52282c10b13-kube-api-access-r5985\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.137670 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.137513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98aff4f4-b527-421b-a36c-f52282c10b13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.239122 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.239073 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5985\" (UniqueName: \"kubernetes.io/projected/98aff4f4-b527-421b-a36c-f52282c10b13-kube-api-access-r5985\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.239330 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.239146 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98aff4f4-b527-421b-a36c-f52282c10b13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.239575 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.239553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98aff4f4-b527-421b-a36c-f52282c10b13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.249323 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.249291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5985\" (UniqueName: \"kubernetes.io/projected/98aff4f4-b527-421b-a36c-f52282c10b13-kube-api-access-r5985\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.333768 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.333680 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:29.650492 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.650412 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr"] May 27 19:38:29.655442 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.655405 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr"] May 27 19:38:29.687315 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.687238 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d"] May 27 19:38:29.703580 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.703382 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:29.704249 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.704030 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d"] May 27 19:38:29.844397 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.844352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9s57d\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:29.844588 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.844441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtwq9\" (UniqueName: \"kubernetes.io/projected/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-kube-api-access-mtwq9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9s57d\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:29.945041 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.945000 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9s57d\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:29.945218 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.945079 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtwq9\" (UniqueName: \"kubernetes.io/projected/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-kube-api-access-mtwq9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9s57d\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:29.945461 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.945440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9s57d\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:29.958606 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:29.958579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtwq9\" (UniqueName: \"kubernetes.io/projected/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-kube-api-access-mtwq9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9s57d\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:30.018865 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:30.018832 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:42.250287 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:42.250260 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d"] May 27 19:38:42.252046 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:38:42.252018 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17e7c6d_98cf_4df1_bcd9_59e14f5c3bb3.slice/crio-cd03abe5e57f2e6f23178fa0f1c4c02f18afc1bc5365939c9d3523053134ee02 WatchSource:0}: Error finding container cd03abe5e57f2e6f23178fa0f1c4c02f18afc1bc5365939c9d3523053134ee02: Status 404 returned error can't find the container with id cd03abe5e57f2e6f23178fa0f1c4c02f18afc1bc5365939c9d3523053134ee02 May 27 19:38:42.267744 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:42.267712 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" event={"ID":"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3","Type":"ContainerStarted","Data":"cd03abe5e57f2e6f23178fa0f1c4c02f18afc1bc5365939c9d3523053134ee02"} May 27 19:38:43.274099 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:43.274042 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" event={"ID":"1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c","Type":"ContainerStarted","Data":"eca1ba21191d019e870e2e978f7f5525fbe0a25e344e0e7ad7ce14d42bec64ae"} May 27 19:38:43.295796 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:43.295741 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b7sj8" podStartSLOduration=2.199816588 podStartE2EDuration="25.295727266s" podCreationTimestamp="2026-05-27 19:38:18 +0000 UTC" firstStartedPulling="2026-05-27 19:38:19.754459878 +0000 UTC m=+343.532987227" lastFinishedPulling="2026-05-27 19:38:42.850370555 +0000 UTC m=+366.628897905" observedRunningTime="2026-05-27 19:38:43.293608074 +0000 UTC m=+367.072135446" watchObservedRunningTime="2026-05-27 19:38:43.295727266 +0000 UTC m=+367.074254638" May 27 19:38:44.638982 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:38:44.638952 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98aff4f4_b527_421b_a36c_f52282c10b13.slice/crio-526a907706fff477cf1eb9280feab43fca0ebe6a2532e10295e786ee50fb61e8 WatchSource:0}: Error finding container 526a907706fff477cf1eb9280feab43fca0ebe6a2532e10295e786ee50fb61e8: Status 404 returned error can't find the container with id 526a907706fff477cf1eb9280feab43fca0ebe6a2532e10295e786ee50fb61e8 May 27 19:38:48.297370 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.297331 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" event={"ID":"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3","Type":"ContainerStarted","Data":"2470126cdd41fb37ccdbacca437fdf52baa55affab6f8ee1890845413b1aa932"} May 27 19:38:48.297802 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.297435 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:38:48.298760 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.298737 2565 generic.go:358] "Generic (PLEG): container finished" podID="98aff4f4-b527-421b-a36c-f52282c10b13" containerID="4fcbfa6d267b79297a111e0c28fdf43f24616b143ac991b1133f1688a84d4f23" exitCode=1 May 27 19:38:48.320476 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.320429 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" podStartSLOduration=13.862234579 podStartE2EDuration="19.320412733s" podCreationTimestamp="2026-05-27 19:38:29 +0000 UTC" firstStartedPulling="2026-05-27 19:38:42.25431768 +0000 UTC m=+366.032845031" lastFinishedPulling="2026-05-27 19:38:47.712495828 +0000 UTC m=+371.491023185" observedRunningTime="2026-05-27 19:38:48.319157586 +0000 UTC m=+372.097684954" watchObservedRunningTime="2026-05-27 19:38:48.320412733 +0000 UTC m=+372.098940105" May 27 19:38:48.324023 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.323997 2565 status_manager.go:895] "Failed to get status for pod" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" is forbidden: User \"system:node:ip-10-0-134-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-76.ec2.internal' and this object" May 27 19:38:48.333547 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.333528 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:48.336094 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.336071 2565 status_manager.go:895] "Failed to get status for pod" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" is forbidden: User \"system:node:ip-10-0-134-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-76.ec2.internal' and this object" May 27 19:38:48.423955 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.423923 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5985\" (UniqueName: \"kubernetes.io/projected/98aff4f4-b527-421b-a36c-f52282c10b13-kube-api-access-r5985\") pod \"98aff4f4-b527-421b-a36c-f52282c10b13\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " May 27 19:38:48.424109 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.423994 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98aff4f4-b527-421b-a36c-f52282c10b13-extensions-socket-volume\") pod \"98aff4f4-b527-421b-a36c-f52282c10b13\" (UID: \"98aff4f4-b527-421b-a36c-f52282c10b13\") " May 27 19:38:48.424234 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.424206 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98aff4f4-b527-421b-a36c-f52282c10b13-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "98aff4f4-b527-421b-a36c-f52282c10b13" (UID: "98aff4f4-b527-421b-a36c-f52282c10b13"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:38:48.424339 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.424324 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98aff4f4-b527-421b-a36c-f52282c10b13-extensions-socket-volume\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:38:48.426148 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.426123 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98aff4f4-b527-421b-a36c-f52282c10b13-kube-api-access-r5985" (OuterVolumeSpecName: "kube-api-access-r5985") pod "98aff4f4-b527-421b-a36c-f52282c10b13" (UID: "98aff4f4-b527-421b-a36c-f52282c10b13"). InnerVolumeSpecName "kube-api-access-r5985". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:38:48.524878 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.524853 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5985\" (UniqueName: \"kubernetes.io/projected/98aff4f4-b527-421b-a36c-f52282c10b13-kube-api-access-r5985\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:38:48.853937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:48.853888 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" path="/var/lib/kubelet/pods/98aff4f4-b527-421b-a36c-f52282c10b13/volumes" May 27 19:38:49.303764 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:49.303735 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" May 27 19:38:49.304224 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:49.303785 2565 scope.go:117] "RemoveContainer" containerID="4fcbfa6d267b79297a111e0c28fdf43f24616b143ac991b1133f1688a84d4f23" May 27 19:38:49.306373 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:49.306347 2565 status_manager.go:895] "Failed to get status for pod" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" is forbidden: User \"system:node:ip-10-0-134-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-76.ec2.internal' and this object" May 27 19:38:49.308427 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:49.308396 2565 status_manager.go:895] "Failed to get status for pod" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2bzgr\" is forbidden: User \"system:node:ip-10-0-134-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-76.ec2.internal' and this object" May 27 19:38:59.306631 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:38:59.306605 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:39:12.172260 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.172226 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d"] May 27 19:39:12.172784 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.172455 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" podUID="e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" containerName="manager" containerID="cri-o://2470126cdd41fb37ccdbacca437fdf52baa55affab6f8ee1890845413b1aa932" gracePeriod=10 May 27 19:39:12.386052 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.386019 2565 generic.go:358] "Generic (PLEG): container finished" podID="e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" containerID="2470126cdd41fb37ccdbacca437fdf52baa55affab6f8ee1890845413b1aa932" exitCode=0 May 27 19:39:12.386191 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.386102 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" event={"ID":"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3","Type":"ContainerDied","Data":"2470126cdd41fb37ccdbacca437fdf52baa55affab6f8ee1890845413b1aa932"} May 27 19:39:12.424098 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.424051 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:39:12.531844 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.531811 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-extensions-socket-volume\") pod \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " May 27 19:39:12.532012 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.531858 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtwq9\" (UniqueName: \"kubernetes.io/projected/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-kube-api-access-mtwq9\") pod \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\" (UID: \"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3\") " May 27 19:39:12.532204 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.532183 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" (UID: "e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:39:12.533992 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.533965 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-kube-api-access-mtwq9" (OuterVolumeSpecName: "kube-api-access-mtwq9") pod "e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" (UID: "e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3"). InnerVolumeSpecName "kube-api-access-mtwq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:39:12.633286 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.633256 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-extensions-socket-volume\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:39:12.633286 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:12.633280 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtwq9\" (UniqueName: \"kubernetes.io/projected/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3-kube-api-access-mtwq9\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:39:13.391718 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:13.391684 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" event={"ID":"e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3","Type":"ContainerDied","Data":"cd03abe5e57f2e6f23178fa0f1c4c02f18afc1bc5365939c9d3523053134ee02"} May 27 19:39:13.391718 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:13.391711 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d" May 27 19:39:13.392275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:13.391731 2565 scope.go:117] "RemoveContainer" containerID="2470126cdd41fb37ccdbacca437fdf52baa55affab6f8ee1890845413b1aa932" May 27 19:39:13.415024 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:13.414999 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d"] May 27 19:39:13.418702 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:13.418681 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9s57d"] May 27 19:39:14.854732 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:14.854698 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" path="/var/lib/kubelet/pods/e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3/volumes" May 27 19:39:19.951484 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951451 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:19.951832 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951814 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" containerName="manager" May 27 19:39:19.951832 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951825 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" containerName="manager" May 27 19:39:19.951937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951847 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" containerName="manager" May 27 19:39:19.951937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951853 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" containerName="manager" May 27 19:39:19.952021 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951944 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e17e7c6d-98cf-4df1-bcd9-59e14f5c3bb3" containerName="manager" May 27 19:39:19.952021 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:19.951956 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="98aff4f4-b527-421b-a36c-f52282c10b13" containerName="manager" May 27 19:39:20.307357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.307277 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:20.307357 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.307313 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:20.307530 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.307416 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.310556 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.310538 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 19:39:20.398799 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.398768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnr8r\" (UniqueName: \"kubernetes.io/projected/b16a1097-45c9-4567-8acf-2aa9217ee976-kube-api-access-rnr8r\") pod \"limitador-limitador-7d549b5b-qf72g\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.398941 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.398805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b16a1097-45c9-4567-8acf-2aa9217ee976-config-file\") pod \"limitador-limitador-7d549b5b-qf72g\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.499719 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.499679 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnr8r\" (UniqueName: \"kubernetes.io/projected/b16a1097-45c9-4567-8acf-2aa9217ee976-kube-api-access-rnr8r\") pod \"limitador-limitador-7d549b5b-qf72g\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.499719 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.499720 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b16a1097-45c9-4567-8acf-2aa9217ee976-config-file\") pod \"limitador-limitador-7d549b5b-qf72g\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.500313 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.500294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b16a1097-45c9-4567-8acf-2aa9217ee976-config-file\") pod \"limitador-limitador-7d549b5b-qf72g\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.507953 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.507932 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnr8r\" (UniqueName: \"kubernetes.io/projected/b16a1097-45c9-4567-8acf-2aa9217ee976-kube-api-access-rnr8r\") pod \"limitador-limitador-7d549b5b-qf72g\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.617657 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.617576 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:20.745193 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.745166 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:20.747401 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:39:20.747372 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16a1097_45c9_4567_8acf_2aa9217ee976.slice/crio-f90a9fb6fc13bbe649ba7ad26abb62bd8ec1bc635f04af514efb3b9d20d73978 WatchSource:0}: Error finding container f90a9fb6fc13bbe649ba7ad26abb62bd8ec1bc635f04af514efb3b9d20d73978: Status 404 returned error can't find the container with id f90a9fb6fc13bbe649ba7ad26abb62bd8ec1bc635f04af514efb3b9d20d73978 May 27 19:39:20.763230 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.763202 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qzlpn"] May 27 19:39:20.767247 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.767210 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:20.770326 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.770298 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xbt6z\"" May 27 19:39:20.774765 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.774739 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qzlpn"] May 27 19:39:20.903918 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:20.903821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqx26\" (UniqueName: \"kubernetes.io/projected/f1cabfab-0875-4f01-ac56-7ac9a143ac6b-kube-api-access-bqx26\") pod \"authorino-f99f4b5cd-qzlpn\" (UID: \"f1cabfab-0875-4f01-ac56-7ac9a143ac6b\") " pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:21.004814 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:21.004778 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqx26\" (UniqueName: \"kubernetes.io/projected/f1cabfab-0875-4f01-ac56-7ac9a143ac6b-kube-api-access-bqx26\") pod \"authorino-f99f4b5cd-qzlpn\" (UID: \"f1cabfab-0875-4f01-ac56-7ac9a143ac6b\") " pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:21.012731 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:21.012707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqx26\" (UniqueName: \"kubernetes.io/projected/f1cabfab-0875-4f01-ac56-7ac9a143ac6b-kube-api-access-bqx26\") pod \"authorino-f99f4b5cd-qzlpn\" (UID: \"f1cabfab-0875-4f01-ac56-7ac9a143ac6b\") " pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:21.077298 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:21.077269 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:21.202080 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:21.202052 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qzlpn"] May 27 19:39:21.204406 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:39:21.204378 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1cabfab_0875_4f01_ac56_7ac9a143ac6b.slice/crio-346c8a945a968aa67f466a3544f420ab279557c898b1dcda590fb36e49f8fccc WatchSource:0}: Error finding container 346c8a945a968aa67f466a3544f420ab279557c898b1dcda590fb36e49f8fccc: Status 404 returned error can't find the container with id 346c8a945a968aa67f466a3544f420ab279557c898b1dcda590fb36e49f8fccc May 27 19:39:21.421699 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:21.421664 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" event={"ID":"f1cabfab-0875-4f01-ac56-7ac9a143ac6b","Type":"ContainerStarted","Data":"346c8a945a968aa67f466a3544f420ab279557c898b1dcda590fb36e49f8fccc"} May 27 19:39:21.422645 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:21.422616 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" event={"ID":"b16a1097-45c9-4567-8acf-2aa9217ee976","Type":"ContainerStarted","Data":"f90a9fb6fc13bbe649ba7ad26abb62bd8ec1bc635f04af514efb3b9d20d73978"} May 27 19:39:25.263927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.263878 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qzlpn"] May 27 19:39:25.440885 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.440850 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" event={"ID":"f1cabfab-0875-4f01-ac56-7ac9a143ac6b","Type":"ContainerStarted","Data":"c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd"} May 27 19:39:25.440885 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.440887 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" podUID="f1cabfab-0875-4f01-ac56-7ac9a143ac6b" containerName="authorino" containerID="cri-o://c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd" gracePeriod=30 May 27 19:39:25.442617 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.442590 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" event={"ID":"b16a1097-45c9-4567-8acf-2aa9217ee976","Type":"ContainerStarted","Data":"9ba49367d6cf333df0522695ea8498c3bfecc77a26f2d8a256befbb4395a15e8"} May 27 19:39:25.442751 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.442732 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:25.458460 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.458362 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" podStartSLOduration=1.318428043 podStartE2EDuration="5.458349809s" podCreationTimestamp="2026-05-27 19:39:20 +0000 UTC" firstStartedPulling="2026-05-27 19:39:21.205722341 +0000 UTC m=+404.984249691" lastFinishedPulling="2026-05-27 19:39:25.345644094 +0000 UTC m=+409.124171457" observedRunningTime="2026-05-27 19:39:25.456873115 +0000 UTC m=+409.235400487" watchObservedRunningTime="2026-05-27 19:39:25.458349809 +0000 UTC m=+409.236877180" May 27 19:39:25.474396 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.474352 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" podStartSLOduration=1.881984908 podStartE2EDuration="6.474339703s" podCreationTimestamp="2026-05-27 19:39:19 +0000 UTC" firstStartedPulling="2026-05-27 19:39:20.749627594 +0000 UTC m=+404.528154945" lastFinishedPulling="2026-05-27 19:39:25.341982383 +0000 UTC m=+409.120509740" observedRunningTime="2026-05-27 19:39:25.472617439 +0000 UTC m=+409.251144812" watchObservedRunningTime="2026-05-27 19:39:25.474339703 +0000 UTC m=+409.252867097" May 27 19:39:25.686725 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.686704 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:25.853723 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.853644 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqx26\" (UniqueName: \"kubernetes.io/projected/f1cabfab-0875-4f01-ac56-7ac9a143ac6b-kube-api-access-bqx26\") pod \"f1cabfab-0875-4f01-ac56-7ac9a143ac6b\" (UID: \"f1cabfab-0875-4f01-ac56-7ac9a143ac6b\") " May 27 19:39:25.855634 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.855610 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1cabfab-0875-4f01-ac56-7ac9a143ac6b-kube-api-access-bqx26" (OuterVolumeSpecName: "kube-api-access-bqx26") pod "f1cabfab-0875-4f01-ac56-7ac9a143ac6b" (UID: "f1cabfab-0875-4f01-ac56-7ac9a143ac6b"). InnerVolumeSpecName "kube-api-access-bqx26". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:39:25.954932 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:25.954868 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqx26\" (UniqueName: \"kubernetes.io/projected/f1cabfab-0875-4f01-ac56-7ac9a143ac6b-kube-api-access-bqx26\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:39:26.449886 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.449847 2565 generic.go:358] "Generic (PLEG): container finished" podID="f1cabfab-0875-4f01-ac56-7ac9a143ac6b" containerID="c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd" exitCode=0 May 27 19:39:26.450328 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.449932 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" May 27 19:39:26.450328 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.449937 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" event={"ID":"f1cabfab-0875-4f01-ac56-7ac9a143ac6b","Type":"ContainerDied","Data":"c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd"} May 27 19:39:26.450328 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.449974 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qzlpn" event={"ID":"f1cabfab-0875-4f01-ac56-7ac9a143ac6b","Type":"ContainerDied","Data":"346c8a945a968aa67f466a3544f420ab279557c898b1dcda590fb36e49f8fccc"} May 27 19:39:26.450328 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.449990 2565 scope.go:117] "RemoveContainer" containerID="c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd" May 27 19:39:26.458076 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.458058 2565 scope.go:117] "RemoveContainer" containerID="c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd" May 27 19:39:26.458400 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:39:26.458361 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd\": container with ID starting with c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd not found: ID does not exist" containerID="c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd" May 27 19:39:26.458490 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.458398 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd"} err="failed to get container status \"c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd\": rpc error: code = NotFound desc = could not find container \"c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd\": container with ID starting with c448fa78e0dd66917dcc0752ebaa7621ffc863a690e6e961dfb4bbfbbb7deebd not found: ID does not exist" May 27 19:39:26.471570 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.471545 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qzlpn"] May 27 19:39:26.477404 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.477384 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qzlpn"] May 27 19:39:26.854869 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:26.854833 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1cabfab-0875-4f01-ac56-7ac9a143ac6b" path="/var/lib/kubelet/pods/f1cabfab-0875-4f01-ac56-7ac9a143ac6b/volumes" May 27 19:39:34.967767 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:34.967733 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:34.968227 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:34.968019 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" podUID="b16a1097-45c9-4567-8acf-2aa9217ee976" containerName="limitador" containerID="cri-o://9ba49367d6cf333df0522695ea8498c3bfecc77a26f2d8a256befbb4395a15e8" gracePeriod=30 May 27 19:39:34.968664 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:34.968646 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:35.483049 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.483017 2565 generic.go:358] "Generic (PLEG): container finished" podID="b16a1097-45c9-4567-8acf-2aa9217ee976" containerID="9ba49367d6cf333df0522695ea8498c3bfecc77a26f2d8a256befbb4395a15e8" exitCode=0 May 27 19:39:35.483049 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.483053 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" event={"ID":"b16a1097-45c9-4567-8acf-2aa9217ee976","Type":"ContainerDied","Data":"9ba49367d6cf333df0522695ea8498c3bfecc77a26f2d8a256befbb4395a15e8"} May 27 19:39:35.901563 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.901539 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:35.942069 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.942042 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b16a1097-45c9-4567-8acf-2aa9217ee976-config-file\") pod \"b16a1097-45c9-4567-8acf-2aa9217ee976\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " May 27 19:39:35.942225 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.942092 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnr8r\" (UniqueName: \"kubernetes.io/projected/b16a1097-45c9-4567-8acf-2aa9217ee976-kube-api-access-rnr8r\") pod \"b16a1097-45c9-4567-8acf-2aa9217ee976\" (UID: \"b16a1097-45c9-4567-8acf-2aa9217ee976\") " May 27 19:39:35.942459 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.942432 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b16a1097-45c9-4567-8acf-2aa9217ee976-config-file" (OuterVolumeSpecName: "config-file") pod "b16a1097-45c9-4567-8acf-2aa9217ee976" (UID: "b16a1097-45c9-4567-8acf-2aa9217ee976"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:39:35.944101 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.944082 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16a1097-45c9-4567-8acf-2aa9217ee976-kube-api-access-rnr8r" (OuterVolumeSpecName: "kube-api-access-rnr8r") pod "b16a1097-45c9-4567-8acf-2aa9217ee976" (UID: "b16a1097-45c9-4567-8acf-2aa9217ee976"). InnerVolumeSpecName "kube-api-access-rnr8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:39:35.982651 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.982622 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xdszf"] May 27 19:39:35.983261 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.983243 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16a1097-45c9-4567-8acf-2aa9217ee976" containerName="limitador" May 27 19:39:35.983306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.983265 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16a1097-45c9-4567-8acf-2aa9217ee976" containerName="limitador" May 27 19:39:35.983306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.983278 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1cabfab-0875-4f01-ac56-7ac9a143ac6b" containerName="authorino" May 27 19:39:35.983306 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.983287 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1cabfab-0875-4f01-ac56-7ac9a143ac6b" containerName="authorino" May 27 19:39:35.983392 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.983370 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="b16a1097-45c9-4567-8acf-2aa9217ee976" containerName="limitador" May 27 19:39:35.983392 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.983387 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1cabfab-0875-4f01-ac56-7ac9a143ac6b" containerName="authorino" May 27 19:39:35.985678 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.985660 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:35.988248 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.988226 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 27 19:39:35.988348 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.988282 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8hz79\"" May 27 19:39:35.993027 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:35.993002 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xdszf"] May 27 19:39:36.042952 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.042881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gf7m\" (UniqueName: \"kubernetes.io/projected/49770621-2da8-4c4a-ad73-0d3332665b0d-kube-api-access-4gf7m\") pod \"postgres-68c4fbbd6f-xdszf\" (UID: \"49770621-2da8-4c4a-ad73-0d3332665b0d\") " pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.043057 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.042961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/49770621-2da8-4c4a-ad73-0d3332665b0d-data\") pod \"postgres-68c4fbbd6f-xdszf\" (UID: \"49770621-2da8-4c4a-ad73-0d3332665b0d\") " pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.043057 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.043024 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b16a1097-45c9-4567-8acf-2aa9217ee976-config-file\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:39:36.043057 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.043040 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnr8r\" (UniqueName: \"kubernetes.io/projected/b16a1097-45c9-4567-8acf-2aa9217ee976-kube-api-access-rnr8r\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:39:36.144371 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.144338 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gf7m\" (UniqueName: \"kubernetes.io/projected/49770621-2da8-4c4a-ad73-0d3332665b0d-kube-api-access-4gf7m\") pod \"postgres-68c4fbbd6f-xdszf\" (UID: \"49770621-2da8-4c4a-ad73-0d3332665b0d\") " pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.144500 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.144401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/49770621-2da8-4c4a-ad73-0d3332665b0d-data\") pod \"postgres-68c4fbbd6f-xdszf\" (UID: \"49770621-2da8-4c4a-ad73-0d3332665b0d\") " pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.144769 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.144750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/49770621-2da8-4c4a-ad73-0d3332665b0d-data\") pod \"postgres-68c4fbbd6f-xdszf\" (UID: \"49770621-2da8-4c4a-ad73-0d3332665b0d\") " pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.152791 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.152768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gf7m\" (UniqueName: \"kubernetes.io/projected/49770621-2da8-4c4a-ad73-0d3332665b0d-kube-api-access-4gf7m\") pod \"postgres-68c4fbbd6f-xdszf\" (UID: \"49770621-2da8-4c4a-ad73-0d3332665b0d\") " pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.297574 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.297471 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:36.423212 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.423188 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xdszf"] May 27 19:39:36.425510 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:39:36.425479 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49770621_2da8_4c4a_ad73_0d3332665b0d.slice/crio-b28633101425e4f895ab9a52bc9fe3e95ccecf97193ce4c65dc63adc90d20151 WatchSource:0}: Error finding container b28633101425e4f895ab9a52bc9fe3e95ccecf97193ce4c65dc63adc90d20151: Status 404 returned error can't find the container with id b28633101425e4f895ab9a52bc9fe3e95ccecf97193ce4c65dc63adc90d20151 May 27 19:39:36.487667 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.487640 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" May 27 19:39:36.487667 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.487647 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qf72g" event={"ID":"b16a1097-45c9-4567-8acf-2aa9217ee976","Type":"ContainerDied","Data":"f90a9fb6fc13bbe649ba7ad26abb62bd8ec1bc635f04af514efb3b9d20d73978"} May 27 19:39:36.487843 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.487692 2565 scope.go:117] "RemoveContainer" containerID="9ba49367d6cf333df0522695ea8498c3bfecc77a26f2d8a256befbb4395a15e8" May 27 19:39:36.488813 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.488784 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-xdszf" event={"ID":"49770621-2da8-4c4a-ad73-0d3332665b0d","Type":"ContainerStarted","Data":"b28633101425e4f895ab9a52bc9fe3e95ccecf97193ce4c65dc63adc90d20151"} May 27 19:39:36.509316 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.509293 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:36.513536 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.513516 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qf72g"] May 27 19:39:36.854448 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:36.854419 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16a1097-45c9-4567-8acf-2aa9217ee976" path="/var/lib/kubelet/pods/b16a1097-45c9-4567-8acf-2aa9217ee976/volumes" May 27 19:39:48.408344 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:48.408318 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 27 19:39:48.532786 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:48.532748 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-xdszf" event={"ID":"49770621-2da8-4c4a-ad73-0d3332665b0d","Type":"ContainerStarted","Data":"eca378098a4e360b1f1ea70c386e51fab7b32bb582b6133dee4ff1a6fb51f606"} May 27 19:39:48.533009 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:48.532990 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:48.555889 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:48.555843 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-xdszf" podStartSLOduration=1.5771341639999998 podStartE2EDuration="13.555829037s" podCreationTimestamp="2026-05-27 19:39:35 +0000 UTC" firstStartedPulling="2026-05-27 19:39:36.426866443 +0000 UTC m=+420.205393794" lastFinishedPulling="2026-05-27 19:39:48.405561318 +0000 UTC m=+432.184088667" observedRunningTime="2026-05-27 19:39:48.553688711 +0000 UTC m=+432.332216082" watchObservedRunningTime="2026-05-27 19:39:48.555829037 +0000 UTC m=+432.334356407" May 27 19:39:54.564421 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:54.564389 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-xdszf" May 27 19:39:55.105874 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.105842 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r67rn"] May 27 19:39:55.112546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.112523 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:55.115474 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.115455 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xbt6z\"" May 27 19:39:55.116691 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.116669 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r67rn"] May 27 19:39:55.212511 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.212467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhpz\" (UniqueName: \"kubernetes.io/projected/872baf70-2042-488b-9e2b-4e4f20a22689-kube-api-access-flhpz\") pod \"authorino-8b475cf9f-r67rn\" (UID: \"872baf70-2042-488b-9e2b-4e4f20a22689\") " pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:55.313803 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.313773 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flhpz\" (UniqueName: \"kubernetes.io/projected/872baf70-2042-488b-9e2b-4e4f20a22689-kube-api-access-flhpz\") pod \"authorino-8b475cf9f-r67rn\" (UID: \"872baf70-2042-488b-9e2b-4e4f20a22689\") " pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:55.325772 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.325744 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhpz\" (UniqueName: \"kubernetes.io/projected/872baf70-2042-488b-9e2b-4e4f20a22689-kube-api-access-flhpz\") pod \"authorino-8b475cf9f-r67rn\" (UID: \"872baf70-2042-488b-9e2b-4e4f20a22689\") " pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:55.330819 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.330799 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r67rn"] May 27 19:39:55.331007 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.330995 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:55.453326 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.453296 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r67rn"] May 27 19:39:55.456448 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:39:55.456424 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod872baf70_2042_488b_9e2b_4e4f20a22689.slice/crio-b196c7509f53a9eff927a0dac3611cbc09d58cb5b3741903791563e033c30fed WatchSource:0}: Error finding container b196c7509f53a9eff927a0dac3611cbc09d58cb5b3741903791563e033c30fed: Status 404 returned error can't find the container with id b196c7509f53a9eff927a0dac3611cbc09d58cb5b3741903791563e033c30fed May 27 19:39:55.557941 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.557896 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-r67rn" event={"ID":"872baf70-2042-488b-9e2b-4e4f20a22689","Type":"ContainerStarted","Data":"b196c7509f53a9eff927a0dac3611cbc09d58cb5b3741903791563e033c30fed"} May 27 19:39:55.650342 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.650278 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d98fb548b-q4rbm"] May 27 19:39:55.656173 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.656158 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.659007 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.658990 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 27 19:39:55.662597 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.662572 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d98fb548b-q4rbm"] May 27 19:39:55.717685 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.717662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55cf8700-1ed2-48d7-993e-fb95a7c0d130-tls-cert\") pod \"authorino-7d98fb548b-q4rbm\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.717829 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.717713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6dcv\" (UniqueName: \"kubernetes.io/projected/55cf8700-1ed2-48d7-993e-fb95a7c0d130-kube-api-access-f6dcv\") pod \"authorino-7d98fb548b-q4rbm\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.819215 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.819188 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55cf8700-1ed2-48d7-993e-fb95a7c0d130-tls-cert\") pod \"authorino-7d98fb548b-q4rbm\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.819323 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.819235 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6dcv\" (UniqueName: \"kubernetes.io/projected/55cf8700-1ed2-48d7-993e-fb95a7c0d130-kube-api-access-f6dcv\") pod \"authorino-7d98fb548b-q4rbm\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.821624 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.821604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55cf8700-1ed2-48d7-993e-fb95a7c0d130-tls-cert\") pod \"authorino-7d98fb548b-q4rbm\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.828462 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.828443 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6dcv\" (UniqueName: \"kubernetes.io/projected/55cf8700-1ed2-48d7-993e-fb95a7c0d130-kube-api-access-f6dcv\") pod \"authorino-7d98fb548b-q4rbm\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:55.966742 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:55.966712 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:39:56.091092 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.091039 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d98fb548b-q4rbm"] May 27 19:39:56.093140 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:39:56.093113 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55cf8700_1ed2_48d7_993e_fb95a7c0d130.slice/crio-35a7783ebfab3256b0c8881b5e74b15a01cdac2ec22c376fb4eae38670a41af2 WatchSource:0}: Error finding container 35a7783ebfab3256b0c8881b5e74b15a01cdac2ec22c376fb4eae38670a41af2: Status 404 returned error can't find the container with id 35a7783ebfab3256b0c8881b5e74b15a01cdac2ec22c376fb4eae38670a41af2 May 27 19:39:56.562360 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.562323 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" event={"ID":"55cf8700-1ed2-48d7-993e-fb95a7c0d130","Type":"ContainerStarted","Data":"4f308943599128ed9d1a29e8bc0c8085fa4674750a0a34c09973d162b3c7faa4"} May 27 19:39:56.562360 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.562361 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" event={"ID":"55cf8700-1ed2-48d7-993e-fb95a7c0d130","Type":"ContainerStarted","Data":"35a7783ebfab3256b0c8881b5e74b15a01cdac2ec22c376fb4eae38670a41af2"} May 27 19:39:56.563824 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.563794 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-r67rn" event={"ID":"872baf70-2042-488b-9e2b-4e4f20a22689","Type":"ContainerStarted","Data":"6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0"} May 27 19:39:56.563955 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.563808 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-r67rn" podUID="872baf70-2042-488b-9e2b-4e4f20a22689" containerName="authorino" containerID="cri-o://6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0" gracePeriod=30 May 27 19:39:56.578458 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.578418 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" podStartSLOduration=1.264012339 podStartE2EDuration="1.57840465s" podCreationTimestamp="2026-05-27 19:39:55 +0000 UTC" firstStartedPulling="2026-05-27 19:39:56.094481743 +0000 UTC m=+439.873009092" lastFinishedPulling="2026-05-27 19:39:56.408874054 +0000 UTC m=+440.187401403" observedRunningTime="2026-05-27 19:39:56.577225074 +0000 UTC m=+440.355752445" watchObservedRunningTime="2026-05-27 19:39:56.57840465 +0000 UTC m=+440.356932020" May 27 19:39:56.592481 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.592433 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-r67rn" podStartSLOduration=1.196156091 podStartE2EDuration="1.592417131s" podCreationTimestamp="2026-05-27 19:39:55 +0000 UTC" firstStartedPulling="2026-05-27 19:39:55.458163696 +0000 UTC m=+439.236691049" lastFinishedPulling="2026-05-27 19:39:55.854424728 +0000 UTC m=+439.632952089" observedRunningTime="2026-05-27 19:39:56.592304093 +0000 UTC m=+440.370831457" watchObservedRunningTime="2026-05-27 19:39:56.592417131 +0000 UTC m=+440.370944502" May 27 19:39:56.793706 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.793683 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:56.928986 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.928950 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flhpz\" (UniqueName: \"kubernetes.io/projected/872baf70-2042-488b-9e2b-4e4f20a22689-kube-api-access-flhpz\") pod \"872baf70-2042-488b-9e2b-4e4f20a22689\" (UID: \"872baf70-2042-488b-9e2b-4e4f20a22689\") " May 27 19:39:56.930929 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:56.930842 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/872baf70-2042-488b-9e2b-4e4f20a22689-kube-api-access-flhpz" (OuterVolumeSpecName: "kube-api-access-flhpz") pod "872baf70-2042-488b-9e2b-4e4f20a22689" (UID: "872baf70-2042-488b-9e2b-4e4f20a22689"). InnerVolumeSpecName "kube-api-access-flhpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:39:57.029660 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.029629 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flhpz\" (UniqueName: \"kubernetes.io/projected/872baf70-2042-488b-9e2b-4e4f20a22689-kube-api-access-flhpz\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:39:57.568557 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.568523 2565 generic.go:358] "Generic (PLEG): container finished" podID="872baf70-2042-488b-9e2b-4e4f20a22689" containerID="6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0" exitCode=0 May 27 19:39:57.568724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.568572 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-r67rn" event={"ID":"872baf70-2042-488b-9e2b-4e4f20a22689","Type":"ContainerDied","Data":"6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0"} May 27 19:39:57.568724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.568576 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r67rn" May 27 19:39:57.568724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.568594 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-r67rn" event={"ID":"872baf70-2042-488b-9e2b-4e4f20a22689","Type":"ContainerDied","Data":"b196c7509f53a9eff927a0dac3611cbc09d58cb5b3741903791563e033c30fed"} May 27 19:39:57.568724 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.568610 2565 scope.go:117] "RemoveContainer" containerID="6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0" May 27 19:39:57.576657 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.576641 2565 scope.go:117] "RemoveContainer" containerID="6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0" May 27 19:39:57.576893 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:39:57.576875 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0\": container with ID starting with 6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0 not found: ID does not exist" containerID="6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0" May 27 19:39:57.576969 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.576916 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0"} err="failed to get container status \"6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0\": rpc error: code = NotFound desc = could not find container \"6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0\": container with ID starting with 6569075a7cf7acb9b63aae1e3f9d4a7fde218f7aae0467103b855be70fb948f0 not found: ID does not exist" May 27 19:39:57.596852 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.596801 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r67rn"] May 27 19:39:57.602274 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:57.602251 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r67rn"] May 27 19:39:58.853815 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:58.853783 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="872baf70-2042-488b-9e2b-4e4f20a22689" path="/var/lib/kubelet/pods/872baf70-2042-488b-9e2b-4e4f20a22689/volumes" May 27 19:39:59.692077 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.692048 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6599688c85-btxtj"] May 27 19:39:59.692500 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.692485 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872baf70-2042-488b-9e2b-4e4f20a22689" containerName="authorino" May 27 19:39:59.692500 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.692500 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="872baf70-2042-488b-9e2b-4e4f20a22689" containerName="authorino" May 27 19:39:59.692611 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.692554 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="872baf70-2042-488b-9e2b-4e4f20a22689" containerName="authorino" May 27 19:39:59.728974 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.728941 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6599688c85-btxtj"] May 27 19:39:59.729115 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.728982 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:39:59.731858 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.731838 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dnnhf\"" May 27 19:39:59.731977 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.731838 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 19:39:59.834175 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.834142 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5895c4df54-4x5vs"] May 27 19:39:59.855584 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.855559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m2qf\" (UniqueName: \"kubernetes.io/projected/33c90659-8e65-4c87-a5a8-9341c7a0f88f-kube-api-access-4m2qf\") pod \"maas-controller-6599688c85-btxtj\" (UID: \"33c90659-8e65-4c87-a5a8-9341c7a0f88f\") " pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:39:59.894577 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.894554 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5895c4df54-4x5vs"] May 27 19:39:59.894708 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.894667 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:39:59.956556 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.956477 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4m2qf\" (UniqueName: \"kubernetes.io/projected/33c90659-8e65-4c87-a5a8-9341c7a0f88f-kube-api-access-4m2qf\") pod \"maas-controller-6599688c85-btxtj\" (UID: \"33c90659-8e65-4c87-a5a8-9341c7a0f88f\") " pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:39:59.956556 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.956519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plsjp\" (UniqueName: \"kubernetes.io/projected/99c16439-cf9b-4bb8-96fd-a350149746ee-kube-api-access-plsjp\") pod \"maas-controller-5895c4df54-4x5vs\" (UID: \"99c16439-cf9b-4bb8-96fd-a350149746ee\") " pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:39:59.966166 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:39:59.966141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m2qf\" (UniqueName: \"kubernetes.io/projected/33c90659-8e65-4c87-a5a8-9341c7a0f88f-kube-api-access-4m2qf\") pod \"maas-controller-6599688c85-btxtj\" (UID: \"33c90659-8e65-4c87-a5a8-9341c7a0f88f\") " pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:40:00.039478 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.039450 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:40:00.057498 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.057470 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plsjp\" (UniqueName: \"kubernetes.io/projected/99c16439-cf9b-4bb8-96fd-a350149746ee-kube-api-access-plsjp\") pod \"maas-controller-5895c4df54-4x5vs\" (UID: \"99c16439-cf9b-4bb8-96fd-a350149746ee\") " pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:40:00.065369 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.065346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plsjp\" (UniqueName: \"kubernetes.io/projected/99c16439-cf9b-4bb8-96fd-a350149746ee-kube-api-access-plsjp\") pod \"maas-controller-5895c4df54-4x5vs\" (UID: \"99c16439-cf9b-4bb8-96fd-a350149746ee\") " pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:40:00.165513 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.165484 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6599688c85-btxtj"] May 27 19:40:00.167653 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:40:00.167627 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c90659_8e65_4c87_a5a8_9341c7a0f88f.slice/crio-fe552ecd80dbdb9b0dff4691aedccae459a01ef72698c660b8a2cfc53faedd03 WatchSource:0}: Error finding container fe552ecd80dbdb9b0dff4691aedccae459a01ef72698c660b8a2cfc53faedd03: Status 404 returned error can't find the container with id fe552ecd80dbdb9b0dff4691aedccae459a01ef72698c660b8a2cfc53faedd03 May 27 19:40:00.204340 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.204311 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:40:00.328805 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.328781 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5895c4df54-4x5vs"] May 27 19:40:00.330575 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:40:00.330532 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c16439_cf9b_4bb8_96fd_a350149746ee.slice/crio-9a947075b11fa0ce761b624c2ecf93e64491100f99f08020890ac1fbe95dc70f WatchSource:0}: Error finding container 9a947075b11fa0ce761b624c2ecf93e64491100f99f08020890ac1fbe95dc70f: Status 404 returned error can't find the container with id 9a947075b11fa0ce761b624c2ecf93e64491100f99f08020890ac1fbe95dc70f May 27 19:40:00.581690 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.581609 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5895c4df54-4x5vs" event={"ID":"99c16439-cf9b-4bb8-96fd-a350149746ee","Type":"ContainerStarted","Data":"9a947075b11fa0ce761b624c2ecf93e64491100f99f08020890ac1fbe95dc70f"} May 27 19:40:00.582680 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:00.582652 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6599688c85-btxtj" event={"ID":"33c90659-8e65-4c87-a5a8-9341c7a0f88f","Type":"ContainerStarted","Data":"fe552ecd80dbdb9b0dff4691aedccae459a01ef72698c660b8a2cfc53faedd03"} May 27 19:40:03.597857 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:03.597821 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5895c4df54-4x5vs" event={"ID":"99c16439-cf9b-4bb8-96fd-a350149746ee","Type":"ContainerStarted","Data":"b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62"} May 27 19:40:03.598310 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:03.598000 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:40:03.599362 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:03.599338 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6599688c85-btxtj" event={"ID":"33c90659-8e65-4c87-a5a8-9341c7a0f88f","Type":"ContainerStarted","Data":"a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678"} May 27 19:40:03.599465 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:03.599452 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:40:03.618403 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:03.618354 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5895c4df54-4x5vs" podStartSLOduration=1.847658013 podStartE2EDuration="4.618339734s" podCreationTimestamp="2026-05-27 19:39:59 +0000 UTC" firstStartedPulling="2026-05-27 19:40:00.331981212 +0000 UTC m=+444.110508562" lastFinishedPulling="2026-05-27 19:40:03.10266293 +0000 UTC m=+446.881190283" observedRunningTime="2026-05-27 19:40:03.616017652 +0000 UTC m=+447.394545026" watchObservedRunningTime="2026-05-27 19:40:03.618339734 +0000 UTC m=+447.396867106" May 27 19:40:03.635126 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:03.635086 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6599688c85-btxtj" podStartSLOduration=1.691637814 podStartE2EDuration="4.635075073s" podCreationTimestamp="2026-05-27 19:39:59 +0000 UTC" firstStartedPulling="2026-05-27 19:40:00.169392859 +0000 UTC m=+443.947920218" lastFinishedPulling="2026-05-27 19:40:03.112830127 +0000 UTC m=+446.891357477" observedRunningTime="2026-05-27 19:40:03.63448335 +0000 UTC m=+447.413010721" watchObservedRunningTime="2026-05-27 19:40:03.635075073 +0000 UTC m=+447.413602442" May 27 19:40:14.607679 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:14.607645 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:40:14.608123 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:14.607897 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:40:14.670893 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:14.670863 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6599688c85-btxtj"] May 27 19:40:14.671073 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:14.671053 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6599688c85-btxtj" podUID="33c90659-8e65-4c87-a5a8-9341c7a0f88f" containerName="manager" containerID="cri-o://a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678" gracePeriod=30 May 27 19:40:14.908321 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:14.908301 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:40:15.095506 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.095480 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m2qf\" (UniqueName: \"kubernetes.io/projected/33c90659-8e65-4c87-a5a8-9341c7a0f88f-kube-api-access-4m2qf\") pod \"33c90659-8e65-4c87-a5a8-9341c7a0f88f\" (UID: \"33c90659-8e65-4c87-a5a8-9341c7a0f88f\") " May 27 19:40:15.097446 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.097412 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c90659-8e65-4c87-a5a8-9341c7a0f88f-kube-api-access-4m2qf" (OuterVolumeSpecName: "kube-api-access-4m2qf") pod "33c90659-8e65-4c87-a5a8-9341c7a0f88f" (UID: "33c90659-8e65-4c87-a5a8-9341c7a0f88f"). InnerVolumeSpecName "kube-api-access-4m2qf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:40:15.196838 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.196814 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m2qf\" (UniqueName: \"kubernetes.io/projected/33c90659-8e65-4c87-a5a8-9341c7a0f88f-kube-api-access-4m2qf\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:40:15.646350 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.646257 2565 generic.go:358] "Generic (PLEG): container finished" podID="33c90659-8e65-4c87-a5a8-9341c7a0f88f" containerID="a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678" exitCode=0 May 27 19:40:15.646350 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.646317 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6599688c85-btxtj" May 27 19:40:15.646995 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.646347 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6599688c85-btxtj" event={"ID":"33c90659-8e65-4c87-a5a8-9341c7a0f88f","Type":"ContainerDied","Data":"a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678"} May 27 19:40:15.646995 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.646382 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6599688c85-btxtj" event={"ID":"33c90659-8e65-4c87-a5a8-9341c7a0f88f","Type":"ContainerDied","Data":"fe552ecd80dbdb9b0dff4691aedccae459a01ef72698c660b8a2cfc53faedd03"} May 27 19:40:15.646995 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.646397 2565 scope.go:117] "RemoveContainer" containerID="a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678" May 27 19:40:15.655115 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.655100 2565 scope.go:117] "RemoveContainer" containerID="a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678" May 27 19:40:15.655366 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:40:15.655348 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678\": container with ID starting with a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678 not found: ID does not exist" containerID="a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678" May 27 19:40:15.655415 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.655374 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678"} err="failed to get container status \"a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678\": rpc error: code = NotFound desc = could not find container \"a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678\": container with ID starting with a91955ff9968b02a48b2df4d9552e45c1b83766bb8a33da229724a15d0b4e678 not found: ID does not exist" May 27 19:40:15.668339 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.668316 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6599688c85-btxtj"] May 27 19:40:15.677123 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:15.677103 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6599688c85-btxtj"] May 27 19:40:16.854340 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:16.854311 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c90659-8e65-4c87-a5a8-9341c7a0f88f" path="/var/lib/kubelet/pods/33c90659-8e65-4c87-a5a8-9341c7a0f88f/volumes" May 27 19:40:34.340092 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.340059 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-549b595c88-4gbnh"] May 27 19:40:34.340546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.340461 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c90659-8e65-4c87-a5a8-9341c7a0f88f" containerName="manager" May 27 19:40:34.340546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.340472 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c90659-8e65-4c87-a5a8-9341c7a0f88f" containerName="manager" May 27 19:40:34.340546 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.340535 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="33c90659-8e65-4c87-a5a8-9341c7a0f88f" containerName="manager" May 27 19:40:34.346342 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.346316 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.349158 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.349129 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 27 19:40:34.350498 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.350474 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5h85p\"" May 27 19:40:34.351779 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.351756 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-549b595c88-4gbnh"] May 27 19:40:34.464824 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.464793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360fc7a4-e93d-42c4-9a26-7162b1f7e034-maas-api-tls\") pod \"maas-api-549b595c88-4gbnh\" (UID: \"360fc7a4-e93d-42c4-9a26-7162b1f7e034\") " pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.465003 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.464849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfhnk\" (UniqueName: \"kubernetes.io/projected/360fc7a4-e93d-42c4-9a26-7162b1f7e034-kube-api-access-cfhnk\") pod \"maas-api-549b595c88-4gbnh\" (UID: \"360fc7a4-e93d-42c4-9a26-7162b1f7e034\") " pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.572927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.568812 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360fc7a4-e93d-42c4-9a26-7162b1f7e034-maas-api-tls\") pod \"maas-api-549b595c88-4gbnh\" (UID: \"360fc7a4-e93d-42c4-9a26-7162b1f7e034\") " pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.572927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.568963 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfhnk\" (UniqueName: \"kubernetes.io/projected/360fc7a4-e93d-42c4-9a26-7162b1f7e034-kube-api-access-cfhnk\") pod \"maas-api-549b595c88-4gbnh\" (UID: \"360fc7a4-e93d-42c4-9a26-7162b1f7e034\") " pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.572927 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.571412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360fc7a4-e93d-42c4-9a26-7162b1f7e034-maas-api-tls\") pod \"maas-api-549b595c88-4gbnh\" (UID: \"360fc7a4-e93d-42c4-9a26-7162b1f7e034\") " pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.577416 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.577389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfhnk\" (UniqueName: \"kubernetes.io/projected/360fc7a4-e93d-42c4-9a26-7162b1f7e034-kube-api-access-cfhnk\") pod \"maas-api-549b595c88-4gbnh\" (UID: \"360fc7a4-e93d-42c4-9a26-7162b1f7e034\") " pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.657275 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.657190 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:34.783695 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:34.783669 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-549b595c88-4gbnh"] May 27 19:40:34.785837 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:40:34.785813 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360fc7a4_e93d_42c4_9a26_7162b1f7e034.slice/crio-e998be90a33405a4aa731b5aa16bb6a8e65ba69bb6f1b3d37546623a2f259ebc WatchSource:0}: Error finding container e998be90a33405a4aa731b5aa16bb6a8e65ba69bb6f1b3d37546623a2f259ebc: Status 404 returned error can't find the container with id e998be90a33405a4aa731b5aa16bb6a8e65ba69bb6f1b3d37546623a2f259ebc May 27 19:40:35.719937 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:35.719878 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-549b595c88-4gbnh" event={"ID":"360fc7a4-e93d-42c4-9a26-7162b1f7e034","Type":"ContainerStarted","Data":"e998be90a33405a4aa731b5aa16bb6a8e65ba69bb6f1b3d37546623a2f259ebc"} May 27 19:40:36.724973 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:36.724934 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-549b595c88-4gbnh" event={"ID":"360fc7a4-e93d-42c4-9a26-7162b1f7e034","Type":"ContainerStarted","Data":"4f03ff64171ea04e0a582f44546f7b1858e8fc12d033b6a4ac2119715c833146"} May 27 19:40:36.725382 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:36.725036 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:36.747046 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:36.747005 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-549b595c88-4gbnh" podStartSLOduration=1.139230017 podStartE2EDuration="2.7469933s" podCreationTimestamp="2026-05-27 19:40:34 +0000 UTC" firstStartedPulling="2026-05-27 19:40:34.787037402 +0000 UTC m=+478.565564751" lastFinishedPulling="2026-05-27 19:40:36.394800681 +0000 UTC m=+480.173328034" observedRunningTime="2026-05-27 19:40:36.746174218 +0000 UTC m=+480.524701589" watchObservedRunningTime="2026-05-27 19:40:36.7469933 +0000 UTC m=+480.525520670" May 27 19:40:36.776303 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:36.776278 2565 scope.go:117] "RemoveContainer" containerID="d9837a98dee64f70cce40a88a33636cfd1e2bd391289a4044ddd3015bc0bfbcb" May 27 19:40:42.733006 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:42.732979 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-549b595c88-4gbnh" May 27 19:40:55.028347 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.028313 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf"] May 27 19:40:55.033359 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.033344 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.037503 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.037481 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 27 19:40:55.037630 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.037485 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 19:40:55.037630 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.037485 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 19:40:55.037630 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.037484 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kph68\"" May 27 19:40:55.043887 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.043868 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf"] May 27 19:40:55.151274 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.151244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.151415 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.151326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218a535a-62f2-44c3-b00f-f48771c807ce-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.151415 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.151370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.151415 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.151404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.151519 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.151425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.151519 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.151440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6ld\" (UniqueName: \"kubernetes.io/projected/218a535a-62f2-44c3-b00f-f48771c807ce-kube-api-access-6h6ld\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252255 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252224 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218a535a-62f2-44c3-b00f-f48771c807ce-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252274 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252304 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252324 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6ld\" (UniqueName: \"kubernetes.io/projected/218a535a-62f2-44c3-b00f-f48771c807ce-kube-api-access-6h6ld\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252400 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252392 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252846 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252825 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252952 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.252952 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.252891 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.254444 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.254426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/218a535a-62f2-44c3-b00f-f48771c807ce-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.254707 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.254691 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218a535a-62f2-44c3-b00f-f48771c807ce-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.260449 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.260425 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6ld\" (UniqueName: \"kubernetes.io/projected/218a535a-62f2-44c3-b00f-f48771c807ce-kube-api-access-6h6ld\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf\" (UID: \"218a535a-62f2-44c3-b00f-f48771c807ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.344700 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.344638 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:40:55.474056 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.474026 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf"] May 27 19:40:55.475835 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:40:55.475804 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218a535a_62f2_44c3_b00f_f48771c807ce.slice/crio-c24bd1b85e83c4dad946f6ea03bec09fe0eee731b2d058610cfb0fb349840b5d WatchSource:0}: Error finding container c24bd1b85e83c4dad946f6ea03bec09fe0eee731b2d058610cfb0fb349840b5d: Status 404 returned error can't find the container with id c24bd1b85e83c4dad946f6ea03bec09fe0eee731b2d058610cfb0fb349840b5d May 27 19:40:55.792943 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:40:55.792893 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" event={"ID":"218a535a-62f2-44c3-b00f-f48771c807ce","Type":"ContainerStarted","Data":"c24bd1b85e83c4dad946f6ea03bec09fe0eee731b2d058610cfb0fb349840b5d"} May 27 19:41:00.813982 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:00.813943 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" event={"ID":"218a535a-62f2-44c3-b00f-f48771c807ce","Type":"ContainerStarted","Data":"09d7e1777f6f1c13497a69cf92c0dcadc565c52ec87822a8cfc8ff3463c78a0b"} May 27 19:41:05.832424 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:05.832341 2565 generic.go:358] "Generic (PLEG): container finished" podID="218a535a-62f2-44c3-b00f-f48771c807ce" containerID="09d7e1777f6f1c13497a69cf92c0dcadc565c52ec87822a8cfc8ff3463c78a0b" exitCode=0 May 27 19:41:05.832810 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:05.832416 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" event={"ID":"218a535a-62f2-44c3-b00f-f48771c807ce","Type":"ContainerDied","Data":"09d7e1777f6f1c13497a69cf92c0dcadc565c52ec87822a8cfc8ff3463c78a0b"} May 27 19:41:07.842003 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:07.841963 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" event={"ID":"218a535a-62f2-44c3-b00f-f48771c807ce","Type":"ContainerStarted","Data":"99ddf2a5d7cde0164685cc05505b4637cd8543c9eae01bc5a5aea064060050a0"} May 27 19:41:07.842374 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:07.842172 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:41:07.864175 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:07.864130 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" podStartSLOduration=1.461017631 podStartE2EDuration="12.86411883s" podCreationTimestamp="2026-05-27 19:40:55 +0000 UTC" firstStartedPulling="2026-05-27 19:40:55.477620431 +0000 UTC m=+499.256147796" lastFinishedPulling="2026-05-27 19:41:06.880721638 +0000 UTC m=+510.659248995" observedRunningTime="2026-05-27 19:41:07.86311919 +0000 UTC m=+511.641646560" watchObservedRunningTime="2026-05-27 19:41:07.86411883 +0000 UTC m=+511.642646201" May 27 19:41:18.859399 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:18.859373 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf" May 27 19:41:59.885739 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:59.885707 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d98fb548b-q4rbm"] May 27 19:41:59.886271 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:41:59.885936 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" podUID="55cf8700-1ed2-48d7-993e-fb95a7c0d130" containerName="authorino" containerID="cri-o://4f308943599128ed9d1a29e8bc0c8085fa4674750a0a34c09973d162b3c7faa4" gracePeriod=30 May 27 19:42:00.029416 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.029376 2565 generic.go:358] "Generic (PLEG): container finished" podID="55cf8700-1ed2-48d7-993e-fb95a7c0d130" containerID="4f308943599128ed9d1a29e8bc0c8085fa4674750a0a34c09973d162b3c7faa4" exitCode=0 May 27 19:42:00.029567 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.029441 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" event={"ID":"55cf8700-1ed2-48d7-993e-fb95a7c0d130","Type":"ContainerDied","Data":"4f308943599128ed9d1a29e8bc0c8085fa4674750a0a34c09973d162b3c7faa4"} May 27 19:42:00.119879 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.119860 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:42:00.226979 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.226943 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55cf8700-1ed2-48d7-993e-fb95a7c0d130-tls-cert\") pod \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " May 27 19:42:00.227142 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.226991 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6dcv\" (UniqueName: \"kubernetes.io/projected/55cf8700-1ed2-48d7-993e-fb95a7c0d130-kube-api-access-f6dcv\") pod \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\" (UID: \"55cf8700-1ed2-48d7-993e-fb95a7c0d130\") " May 27 19:42:00.228979 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.228947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cf8700-1ed2-48d7-993e-fb95a7c0d130-kube-api-access-f6dcv" (OuterVolumeSpecName: "kube-api-access-f6dcv") pod "55cf8700-1ed2-48d7-993e-fb95a7c0d130" (UID: "55cf8700-1ed2-48d7-993e-fb95a7c0d130"). InnerVolumeSpecName "kube-api-access-f6dcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:42:00.236867 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.236844 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55cf8700-1ed2-48d7-993e-fb95a7c0d130-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "55cf8700-1ed2-48d7-993e-fb95a7c0d130" (UID: "55cf8700-1ed2-48d7-993e-fb95a7c0d130"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:42:00.328366 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.328340 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55cf8700-1ed2-48d7-993e-fb95a7c0d130-tls-cert\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:42:00.328366 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:00.328363 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6dcv\" (UniqueName: \"kubernetes.io/projected/55cf8700-1ed2-48d7-993e-fb95a7c0d130-kube-api-access-f6dcv\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:42:01.034613 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:01.034576 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" May 27 19:42:01.035068 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:01.034613 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d98fb548b-q4rbm" event={"ID":"55cf8700-1ed2-48d7-993e-fb95a7c0d130","Type":"ContainerDied","Data":"35a7783ebfab3256b0c8881b5e74b15a01cdac2ec22c376fb4eae38670a41af2"} May 27 19:42:01.035068 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:01.034665 2565 scope.go:117] "RemoveContainer" containerID="4f308943599128ed9d1a29e8bc0c8085fa4674750a0a34c09973d162b3c7faa4" May 27 19:42:01.074446 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:01.074411 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d98fb548b-q4rbm"] May 27 19:42:01.080897 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:01.080875 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d98fb548b-q4rbm"] May 27 19:42:02.854505 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:42:02.854469 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55cf8700-1ed2-48d7-993e-fb95a7c0d130" path="/var/lib/kubelet/pods/55cf8700-1ed2-48d7-993e-fb95a7c0d130/volumes" May 27 19:43:22.768406 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:22.768370 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5895c4df54-4x5vs"] May 27 19:43:22.768882 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:22.768609 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5895c4df54-4x5vs" podUID="99c16439-cf9b-4bb8-96fd-a350149746ee" containerName="manager" containerID="cri-o://b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62" gracePeriod=30 May 27 19:43:23.008709 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.008680 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:43:23.076760 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.076681 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plsjp\" (UniqueName: \"kubernetes.io/projected/99c16439-cf9b-4bb8-96fd-a350149746ee-kube-api-access-plsjp\") pod \"99c16439-cf9b-4bb8-96fd-a350149746ee\" (UID: \"99c16439-cf9b-4bb8-96fd-a350149746ee\") " May 27 19:43:23.078665 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.078637 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c16439-cf9b-4bb8-96fd-a350149746ee-kube-api-access-plsjp" (OuterVolumeSpecName: "kube-api-access-plsjp") pod "99c16439-cf9b-4bb8-96fd-a350149746ee" (UID: "99c16439-cf9b-4bb8-96fd-a350149746ee"). InnerVolumeSpecName "kube-api-access-plsjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:43:23.177303 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.177272 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plsjp\" (UniqueName: \"kubernetes.io/projected/99c16439-cf9b-4bb8-96fd-a350149746ee-kube-api-access-plsjp\") on node \"ip-10-0-134-76.ec2.internal\" DevicePath \"\"" May 27 19:43:23.331130 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.331037 2565 generic.go:358] "Generic (PLEG): container finished" podID="99c16439-cf9b-4bb8-96fd-a350149746ee" containerID="b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62" exitCode=0 May 27 19:43:23.331130 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.331099 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5895c4df54-4x5vs" May 27 19:43:23.331319 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.331128 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5895c4df54-4x5vs" event={"ID":"99c16439-cf9b-4bb8-96fd-a350149746ee","Type":"ContainerDied","Data":"b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62"} May 27 19:43:23.331319 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.331162 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5895c4df54-4x5vs" event={"ID":"99c16439-cf9b-4bb8-96fd-a350149746ee","Type":"ContainerDied","Data":"9a947075b11fa0ce761b624c2ecf93e64491100f99f08020890ac1fbe95dc70f"} May 27 19:43:23.331319 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.331177 2565 scope.go:117] "RemoveContainer" containerID="b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62" May 27 19:43:23.339578 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.339561 2565 scope.go:117] "RemoveContainer" containerID="b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62" May 27 19:43:23.339825 ip-10-0-134-76 kubenswrapper[2565]: E0527 19:43:23.339811 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62\": container with ID starting with b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62 not found: ID does not exist" containerID="b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62" May 27 19:43:23.339860 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.339832 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62"} err="failed to get container status \"b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62\": rpc error: code = NotFound desc = could not find container \"b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62\": container with ID starting with b004dc1ba4c1fa6fa6fc250058e6d2bd7fa69c19da47024d12aedcbdfd57dd62 not found: ID does not exist" May 27 19:43:23.352032 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.352006 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5895c4df54-4x5vs"] May 27 19:43:23.355953 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:23.355932 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5895c4df54-4x5vs"] May 27 19:43:24.053879 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.053842 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5895c4df54-fcnf7"] May 27 19:43:24.054281 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.054268 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c16439-cf9b-4bb8-96fd-a350149746ee" containerName="manager" May 27 19:43:24.054322 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.054282 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c16439-cf9b-4bb8-96fd-a350149746ee" containerName="manager" May 27 19:43:24.054322 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.054293 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cf8700-1ed2-48d7-993e-fb95a7c0d130" containerName="authorino" May 27 19:43:24.054322 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.054301 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cf8700-1ed2-48d7-993e-fb95a7c0d130" containerName="authorino" May 27 19:43:24.054410 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.054356 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="55cf8700-1ed2-48d7-993e-fb95a7c0d130" containerName="authorino" May 27 19:43:24.054410 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.054370 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="99c16439-cf9b-4bb8-96fd-a350149746ee" containerName="manager" May 27 19:43:24.058857 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.058839 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:43:24.061525 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.061501 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 19:43:24.061525 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.061519 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dnnhf\"" May 27 19:43:24.066685 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.066662 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5895c4df54-fcnf7"] May 27 19:43:24.085841 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.085815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmbd\" (UniqueName: \"kubernetes.io/projected/89e092aa-b914-4d76-b0c4-0858fa1932ee-kube-api-access-8fmbd\") pod \"maas-controller-5895c4df54-fcnf7\" (UID: \"89e092aa-b914-4d76-b0c4-0858fa1932ee\") " pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:43:24.186474 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.186437 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmbd\" (UniqueName: \"kubernetes.io/projected/89e092aa-b914-4d76-b0c4-0858fa1932ee-kube-api-access-8fmbd\") pod \"maas-controller-5895c4df54-fcnf7\" (UID: \"89e092aa-b914-4d76-b0c4-0858fa1932ee\") " pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:43:24.196057 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.196030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmbd\" (UniqueName: \"kubernetes.io/projected/89e092aa-b914-4d76-b0c4-0858fa1932ee-kube-api-access-8fmbd\") pod \"maas-controller-5895c4df54-fcnf7\" (UID: \"89e092aa-b914-4d76-b0c4-0858fa1932ee\") " pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:43:24.370185 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.370102 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:43:24.498821 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.498679 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5895c4df54-fcnf7"] May 27 19:43:24.501121 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:43:24.501092 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e092aa_b914_4d76_b0c4_0858fa1932ee.slice/crio-f6fd075a8c512a1bd4e0cd3c1565a1c8875968a757a8a7cd4eb7d090b6c72fdc WatchSource:0}: Error finding container f6fd075a8c512a1bd4e0cd3c1565a1c8875968a757a8a7cd4eb7d090b6c72fdc: Status 404 returned error can't find the container with id f6fd075a8c512a1bd4e0cd3c1565a1c8875968a757a8a7cd4eb7d090b6c72fdc May 27 19:43:24.502273 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.502256 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:43:24.862464 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:24.862426 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99c16439-cf9b-4bb8-96fd-a350149746ee" path="/var/lib/kubelet/pods/99c16439-cf9b-4bb8-96fd-a350149746ee/volumes" May 27 19:43:25.340975 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:25.340939 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5895c4df54-fcnf7" event={"ID":"89e092aa-b914-4d76-b0c4-0858fa1932ee","Type":"ContainerStarted","Data":"c47ba65e17d118a0d6aa224feb41065acd1702916c4b691cca8c7d76d569e111"} May 27 19:43:25.340975 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:25.340976 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5895c4df54-fcnf7" event={"ID":"89e092aa-b914-4d76-b0c4-0858fa1932ee","Type":"ContainerStarted","Data":"f6fd075a8c512a1bd4e0cd3c1565a1c8875968a757a8a7cd4eb7d090b6c72fdc"} May 27 19:43:25.341381 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:25.341055 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:43:25.360364 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:25.360325 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5895c4df54-fcnf7" podStartSLOduration=0.925687 podStartE2EDuration="1.360313309s" podCreationTimestamp="2026-05-27 19:43:24 +0000 UTC" firstStartedPulling="2026-05-27 19:43:24.50237577 +0000 UTC m=+648.280903120" lastFinishedPulling="2026-05-27 19:43:24.93700208 +0000 UTC m=+648.715529429" observedRunningTime="2026-05-27 19:43:25.358867568 +0000 UTC m=+649.137394940" watchObservedRunningTime="2026-05-27 19:43:25.360313309 +0000 UTC m=+649.138840678" May 27 19:43:36.351553 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:43:36.351521 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5895c4df54-fcnf7" May 27 19:54:50.202211 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.202177 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9"] May 27 19:54:50.205813 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.205794 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.208687 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.208661 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkmg8\"" May 27 19:54:50.216542 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.216517 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9"] May 27 19:54:50.345983 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.345943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkrnl\" (UniqueName: \"kubernetes.io/projected/28d6cb32-0178-4600-a8f5-e9eb3f63d490-kube-api-access-rkrnl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8h9p9\" (UID: \"28d6cb32-0178-4600-a8f5-e9eb3f63d490\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.346164 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.346024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28d6cb32-0178-4600-a8f5-e9eb3f63d490-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8h9p9\" (UID: \"28d6cb32-0178-4600-a8f5-e9eb3f63d490\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.446477 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.446434 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkrnl\" (UniqueName: \"kubernetes.io/projected/28d6cb32-0178-4600-a8f5-e9eb3f63d490-kube-api-access-rkrnl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8h9p9\" (UID: \"28d6cb32-0178-4600-a8f5-e9eb3f63d490\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.446659 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.446501 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28d6cb32-0178-4600-a8f5-e9eb3f63d490-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8h9p9\" (UID: \"28d6cb32-0178-4600-a8f5-e9eb3f63d490\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.446833 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.446817 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28d6cb32-0178-4600-a8f5-e9eb3f63d490-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8h9p9\" (UID: \"28d6cb32-0178-4600-a8f5-e9eb3f63d490\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.455693 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.455620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkrnl\" (UniqueName: \"kubernetes.io/projected/28d6cb32-0178-4600-a8f5-e9eb3f63d490-kube-api-access-rkrnl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8h9p9\" (UID: \"28d6cb32-0178-4600-a8f5-e9eb3f63d490\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.516300 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.516270 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:50.659239 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.659215 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9"] May 27 19:54:50.661293 ip-10-0-134-76 kubenswrapper[2565]: W0527 19:54:50.661264 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d6cb32_0178_4600_a8f5_e9eb3f63d490.slice/crio-cc84187dae76a1bb270b98744eaf584be9e1a082319c7497430caf013f50caf1 WatchSource:0}: Error finding container cc84187dae76a1bb270b98744eaf584be9e1a082319c7497430caf013f50caf1: Status 404 returned error can't find the container with id cc84187dae76a1bb270b98744eaf584be9e1a082319c7497430caf013f50caf1 May 27 19:54:50.663822 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.663807 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:54:50.717376 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:50.717271 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" event={"ID":"28d6cb32-0178-4600-a8f5-e9eb3f63d490","Type":"ContainerStarted","Data":"cc84187dae76a1bb270b98744eaf584be9e1a082319c7497430caf013f50caf1"} May 27 19:54:51.722823 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:51.722785 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" event={"ID":"28d6cb32-0178-4600-a8f5-e9eb3f63d490","Type":"ContainerStarted","Data":"9b315b374ccecae70d9e8046bffe3a25f49c69bc7a8d8a37a2581ed37157a06f"} May 27 19:54:51.723264 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:51.722850 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 19:54:51.744635 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:54:51.744576 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" podStartSLOduration=1.744559135 podStartE2EDuration="1.744559135s" podCreationTimestamp="2026-05-27 19:54:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:54:51.741788891 +0000 UTC m=+1335.520316297" watchObservedRunningTime="2026-05-27 19:54:51.744559135 +0000 UTC m=+1335.523086584" May 27 19:55:02.729283 ip-10-0-134-76 kubenswrapper[2565]: I0527 19:55:02.729204 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8h9p9" May 27 20:04:37.605493 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:37.605460 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-549b595c88-4gbnh_360fc7a4-e93d-42c4-9a26-7162b1f7e034/maas-api/0.log" May 27 20:04:37.926543 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:37.926464 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5895c4df54-fcnf7_89e092aa-b914-4d76-b0c4-0858fa1932ee/manager/0.log" May 27 20:04:38.199195 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:38.199159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f485759dc-6px9h_ad960697-af6d-45b7-8c01-c98f6cb19ff8/manager/0.log" May 27 20:04:38.520475 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:38.520399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-xdszf_49770621-2da8-4c4a-ad73-0d3332665b0d/postgres/0.log" May 27 20:04:40.026000 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:40.025973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-b7sj8_1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c/kuadrant-console-plugin/0.log" May 27 20:04:40.245991 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:40.245946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-8h9p9_28d6cb32-0178-4600-a8f5-e9eb3f63d490/manager/0.log" May 27 20:04:41.114421 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:41.114386 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c44b8656c-kx5x7_96c161b6-a6a6-4d8a-9fbb-90376fe180e2/kube-auth-proxy/0.log" May 27 20:04:42.105683 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:42.105643 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf_218a535a-62f2-44c3-b00f-f48771c807ce/storage-initializer/0.log" May 27 20:04:42.112757 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:42.112725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccttfvf_218a535a-62f2-44c3-b00f-f48771c807ce/main/0.log" May 27 20:04:45.839504 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.839472 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9lbxp/must-gather-2db9h"] May 27 20:04:45.843355 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.843334 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:45.846166 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.846148 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9lbxp\"/\"kube-root-ca.crt\"" May 27 20:04:45.846251 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.846178 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9lbxp\"/\"default-dockercfg-6x8sd\"" May 27 20:04:45.847214 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.847197 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9lbxp\"/\"openshift-service-ca.crt\"" May 27 20:04:45.859305 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.859276 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lbxp/must-gather-2db9h"] May 27 20:04:45.962546 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.962505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjs9\" (UniqueName: \"kubernetes.io/projected/e769704b-0dfe-4fbc-ad94-1ad86656b439-kube-api-access-rwjs9\") pod \"must-gather-2db9h\" (UID: \"e769704b-0dfe-4fbc-ad94-1ad86656b439\") " pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:45.963196 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:45.963165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e769704b-0dfe-4fbc-ad94-1ad86656b439-must-gather-output\") pod \"must-gather-2db9h\" (UID: \"e769704b-0dfe-4fbc-ad94-1ad86656b439\") " pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:46.063862 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.063827 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e769704b-0dfe-4fbc-ad94-1ad86656b439-must-gather-output\") pod \"must-gather-2db9h\" (UID: \"e769704b-0dfe-4fbc-ad94-1ad86656b439\") " pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:46.064037 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.063870 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjs9\" (UniqueName: \"kubernetes.io/projected/e769704b-0dfe-4fbc-ad94-1ad86656b439-kube-api-access-rwjs9\") pod \"must-gather-2db9h\" (UID: \"e769704b-0dfe-4fbc-ad94-1ad86656b439\") " pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:46.064174 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.064155 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e769704b-0dfe-4fbc-ad94-1ad86656b439-must-gather-output\") pod \"must-gather-2db9h\" (UID: \"e769704b-0dfe-4fbc-ad94-1ad86656b439\") " pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:46.072000 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.071972 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjs9\" (UniqueName: \"kubernetes.io/projected/e769704b-0dfe-4fbc-ad94-1ad86656b439-kube-api-access-rwjs9\") pod \"must-gather-2db9h\" (UID: \"e769704b-0dfe-4fbc-ad94-1ad86656b439\") " pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:46.153203 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.153145 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lbxp/must-gather-2db9h" May 27 20:04:46.286255 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.286225 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lbxp/must-gather-2db9h"] May 27 20:04:46.288224 ip-10-0-134-76 kubenswrapper[2565]: W0527 20:04:46.288198 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode769704b_0dfe_4fbc_ad94_1ad86656b439.slice/crio-8a3066481c9803544f3344ff9fc81435ed916dc1c552b8b77e2051b1db2ce6a3 WatchSource:0}: Error finding container 8a3066481c9803544f3344ff9fc81435ed916dc1c552b8b77e2051b1db2ce6a3: Status 404 returned error can't find the container with id 8a3066481c9803544f3344ff9fc81435ed916dc1c552b8b77e2051b1db2ce6a3 May 27 20:04:46.289950 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.289933 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:04:46.865889 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:46.865851 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/must-gather-2db9h" event={"ID":"e769704b-0dfe-4fbc-ad94-1ad86656b439","Type":"ContainerStarted","Data":"8a3066481c9803544f3344ff9fc81435ed916dc1c552b8b77e2051b1db2ce6a3"} May 27 20:04:47.871452 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:47.871413 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/must-gather-2db9h" event={"ID":"e769704b-0dfe-4fbc-ad94-1ad86656b439","Type":"ContainerStarted","Data":"f58b60a62121dd3831acbf405547b6475e5e364b9fbca48cd2726be566c9bb30"} May 27 20:04:47.871452 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:47.871455 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/must-gather-2db9h" event={"ID":"e769704b-0dfe-4fbc-ad94-1ad86656b439","Type":"ContainerStarted","Data":"947a8913cf46dfdaccddffd9f5d22c32712f5a718f5c0006d39a2dac18ca205e"} May 27 20:04:47.889080 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:47.889026 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9lbxp/must-gather-2db9h" podStartSLOduration=2.164458256 podStartE2EDuration="2.889012179s" podCreationTimestamp="2026-05-27 20:04:45 +0000 UTC" firstStartedPulling="2026-05-27 20:04:46.290092922 +0000 UTC m=+1930.068620272" lastFinishedPulling="2026-05-27 20:04:47.014646842 +0000 UTC m=+1930.793174195" observedRunningTime="2026-05-27 20:04:47.88631276 +0000 UTC m=+1931.664840134" watchObservedRunningTime="2026-05-27 20:04:47.889012179 +0000 UTC m=+1931.667539551" May 27 20:04:48.604890 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:48.604857 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h7zhs_a70f2617-ebb8-4259-b2fe-2ec67d920efb/global-pull-secret-syncer/0.log" May 27 20:04:48.729424 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:48.729384 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bz9w8_d0d0dee9-85a6-4d5a-bf6d-3d575a8cea16/konnectivity-agent/0.log" May 27 20:04:48.811304 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:48.811277 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-76.ec2.internal_0364653ed866562d9f25e010755536fc/haproxy/0.log" May 27 20:04:53.263331 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:53.263302 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-b7sj8_1ef658e7-ba0e-42c8-a2a6-639cbbc6a10c/kuadrant-console-plugin/0.log" May 27 20:04:53.391758 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:53.391102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-8h9p9_28d6cb32-0178-4600-a8f5-e9eb3f63d490/manager/0.log" May 27 20:04:55.075785 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.075751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/alertmanager/0.log" May 27 20:04:55.107726 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.107701 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/config-reloader/0.log" May 27 20:04:55.131260 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.131228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/kube-rbac-proxy-web/0.log" May 27 20:04:55.154274 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.154240 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/kube-rbac-proxy/0.log" May 27 20:04:55.177414 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.177376 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/kube-rbac-proxy-metric/0.log" May 27 20:04:55.197641 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.197607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/prom-label-proxy/0.log" May 27 20:04:55.227995 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.227924 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c14eb7e6-5870-4784-8ec8-a57fec2400f0/init-config-reloader/0.log" May 27 20:04:55.290722 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.290691 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-mnz5h_d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196/kube-state-metrics/0.log" May 27 20:04:55.306539 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.306512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-mnz5h_d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196/kube-rbac-proxy-main/0.log" May 27 20:04:55.326055 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.326013 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-mnz5h_d8bd5d21-e3f8-42aa-a8b9-cbf8b1ceb196/kube-rbac-proxy-self/0.log" May 27 20:04:55.365557 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.365482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6777cbd889-7wkrt_ae154b2e-a80b-4d75-9f0d-a86de498d845/metrics-server/0.log" May 27 20:04:55.386112 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.386083 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-2hpn5_0463daa0-4c0c-4717-b9ae-fbc176467933/monitoring-plugin/0.log" May 27 20:04:55.478767 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.478676 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd2vz_def24bf3-3c27-43f8-b6f8-4c00bf0906ef/node-exporter/0.log" May 27 20:04:55.499491 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.499461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd2vz_def24bf3-3c27-43f8-b6f8-4c00bf0906ef/kube-rbac-proxy/0.log" May 27 20:04:55.517802 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.517772 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd2vz_def24bf3-3c27-43f8-b6f8-4c00bf0906ef/init-textfile/0.log" May 27 20:04:55.614922 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.614880 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mj2qg_3bafaf84-56fa-4853-944a-720b432958fb/kube-rbac-proxy-main/0.log" May 27 20:04:55.634105 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.634072 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mj2qg_3bafaf84-56fa-4853-944a-720b432958fb/kube-rbac-proxy-self/0.log" May 27 20:04:55.653031 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.653001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mj2qg_3bafaf84-56fa-4853-944a-720b432958fb/openshift-state-metrics/0.log" May 27 20:04:55.688026 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.688000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/prometheus/0.log" May 27 20:04:55.707716 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.707689 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/config-reloader/0.log" May 27 20:04:55.727889 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.727854 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/thanos-sidecar/0.log" May 27 20:04:55.747237 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.747158 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/kube-rbac-proxy-web/0.log" May 27 20:04:55.769366 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.769331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/kube-rbac-proxy/0.log" May 27 20:04:55.788312 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.788279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/kube-rbac-proxy-thanos/0.log" May 27 20:04:55.806435 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.806366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4046f5-cb2d-4138-9386-e021587d1650/init-config-reloader/0.log" May 27 20:04:55.834446 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.834413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-bzcjd_ab3cf7c0-e124-447f-9eeb-277438dc4852/prometheus-operator/0.log" May 27 20:04:55.852849 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.852819 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-bzcjd_ab3cf7c0-e124-447f-9eeb-277438dc4852/kube-rbac-proxy/0.log" May 27 20:04:55.872424 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.872395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-klfw2_4287aacd-dcdc-4412-969d-9cbee10a0cc6/prometheus-operator-admission-webhook/0.log" May 27 20:04:55.899925 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.899883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f9c7ccb6-9lvss_a41bdd0f-2d09-43e7-b659-aec13d390774/telemeter-client/0.log" May 27 20:04:55.923577 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.923534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f9c7ccb6-9lvss_a41bdd0f-2d09-43e7-b659-aec13d390774/reload/0.log" May 27 20:04:55.943459 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.943429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f9c7ccb6-9lvss_a41bdd0f-2d09-43e7-b659-aec13d390774/kube-rbac-proxy/0.log" May 27 20:04:55.975456 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.975429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64bbd49d6b-x6c46_2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc/thanos-query/0.log" May 27 20:04:55.996166 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:55.996135 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64bbd49d6b-x6c46_2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc/kube-rbac-proxy-web/0.log" May 27 20:04:56.016259 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:56.016161 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64bbd49d6b-x6c46_2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc/kube-rbac-proxy/0.log" May 27 20:04:56.035388 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:56.035345 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64bbd49d6b-x6c46_2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc/prom-label-proxy/0.log" May 27 20:04:56.053150 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:56.053121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64bbd49d6b-x6c46_2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc/kube-rbac-proxy-rules/0.log" May 27 20:04:56.070986 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:56.070959 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64bbd49d6b-x6c46_2fc1f2e9-8532-40f5-8d3a-69ec50f0aedc/kube-rbac-proxy-metrics/0.log" May 27 20:04:57.522169 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.522131 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn"] May 27 20:04:57.529890 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.529858 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.536778 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.536108 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn"] May 27 20:04:57.689673 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.689642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kp58\" (UniqueName: \"kubernetes.io/projected/4159233c-d512-424d-9f7f-bd4fe9047eff-kube-api-access-4kp58\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.689830 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.689692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-sys\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.689830 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.689737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-podres\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.689830 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.689771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-proc\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.689830 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.689785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-lib-modules\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.790597 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.790510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kp58\" (UniqueName: \"kubernetes.io/projected/4159233c-d512-424d-9f7f-bd4fe9047eff-kube-api-access-4kp58\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791201 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791175 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-sys\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791351 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791226 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-podres\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791351 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791280 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-proc\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791351 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-lib-modules\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791351 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-sys\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791560 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-podres\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791560 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-proc\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.791560 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.791472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4159233c-d512-424d-9f7f-bd4fe9047eff-lib-modules\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.799513 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.799481 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kp58\" (UniqueName: \"kubernetes.io/projected/4159233c-d512-424d-9f7f-bd4fe9047eff-kube-api-access-4kp58\") pod \"perf-node-gather-daemonset-vkrhn\" (UID: \"4159233c-d512-424d-9f7f-bd4fe9047eff\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:57.843458 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:57.843433 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:58.004653 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:58.004604 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn"] May 27 20:04:58.009001 ip-10-0-134-76 kubenswrapper[2565]: W0527 20:04:58.008966 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4159233c_d512_424d_9f7f_bd4fe9047eff.slice/crio-70762c9b599e177893c7e75e3ffceeab3e8037f96dfca909b741c9ffa88fb6cd WatchSource:0}: Error finding container 70762c9b599e177893c7e75e3ffceeab3e8037f96dfca909b741c9ffa88fb6cd: Status 404 returned error can't find the container with id 70762c9b599e177893c7e75e3ffceeab3e8037f96dfca909b741c9ffa88fb6cd May 27 20:04:58.216804 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:58.216765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-6ntxh_8e2f3d98-7c67-4cda-984b-9676b7af7d0d/download-server/0.log" May 27 20:04:58.945165 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:58.945121 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" event={"ID":"4159233c-d512-424d-9f7f-bd4fe9047eff","Type":"ContainerStarted","Data":"764419a9ad19990b1ae4bc3659f5d55f2f2898286fecddb9362ee6233410e572"} May 27 20:04:58.945165 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:58.945157 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" event={"ID":"4159233c-d512-424d-9f7f-bd4fe9047eff","Type":"ContainerStarted","Data":"70762c9b599e177893c7e75e3ffceeab3e8037f96dfca909b741c9ffa88fb6cd"} May 27 20:04:58.945699 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:58.945247 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:04:58.963128 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:58.963066 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" podStartSLOduration=1.963047611 podStartE2EDuration="1.963047611s" podCreationTimestamp="2026-05-27 20:04:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:04:58.960765403 +0000 UTC m=+1942.739292774" watchObservedRunningTime="2026-05-27 20:04:58.963047611 +0000 UTC m=+1942.741574984" May 27 20:04:59.449662 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:59.449632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-258f6_69741760-2182-4add-b5a5-e22b368f39c9/dns/0.log" May 27 20:04:59.467965 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:59.467933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-258f6_69741760-2182-4add-b5a5-e22b368f39c9/kube-rbac-proxy/0.log" May 27 20:04:59.604744 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:04:59.604712 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l58z4_7a37b93b-7bef-46f7-b4e9-13cb3520156c/dns-node-resolver/0.log" May 27 20:05:00.082595 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:00.082568 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4hsf5_94c97bd7-b8dc-4298-b4a5-aad6d5d2122b/node-ca/0.log" May 27 20:05:01.104140 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:01.104114 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c44b8656c-kx5x7_96c161b6-a6a6-4d8a-9fbb-90376fe180e2/kube-auth-proxy/0.log" May 27 20:05:01.751158 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:01.751134 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lhx9_4de2f077-1aea-4595-b0bb-b6ed11e753a8/serve-healthcheck-canary/0.log" May 27 20:05:02.346164 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:02.346135 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjv27_587775c1-24d5-4668-9a58-dc877febc9c3/kube-rbac-proxy/0.log" May 27 20:05:02.363573 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:02.363546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjv27_587775c1-24d5-4668-9a58-dc877febc9c3/exporter/0.log" May 27 20:05:02.381920 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:02.381872 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjv27_587775c1-24d5-4668-9a58-dc877febc9c3/extractor/0.log" May 27 20:05:04.335794 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:04.335759 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-549b595c88-4gbnh_360fc7a4-e93d-42c4-9a26-7162b1f7e034/maas-api/0.log" May 27 20:05:04.484920 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:04.484868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5895c4df54-fcnf7_89e092aa-b914-4d76-b0c4-0858fa1932ee/manager/0.log" May 27 20:05:04.548656 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:04.548610 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f485759dc-6px9h_ad960697-af6d-45b7-8c01-c98f6cb19ff8/manager/0.log" May 27 20:05:04.635188 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:04.635105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-xdszf_49770621-2da8-4c4a-ad73-0d3332665b0d/postgres/0.log" May 27 20:05:04.959741 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:04.959717 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-vkrhn" May 27 20:05:05.756989 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:05.756959 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8459f94865-q6nsk_60d3aef6-6526-400c-a568-273da9b7843b/manager/0.log" May 27 20:05:05.784061 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:05.784028 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-m2m2c_4a5ca5b3-1e60-40c8-9a7e-a95481072c47/openshift-lws-operator/0.log" May 27 20:05:10.495929 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:10.495878 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-knwcg_0838a755-adc0-449e-aa12-f57a27e0b11e/migrator/0.log" May 27 20:05:10.512608 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:10.512581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-knwcg_0838a755-adc0-449e-aa12-f57a27e0b11e/graceful-termination/0.log" May 27 20:05:12.047345 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.047317 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/kube-multus-additional-cni-plugins/0.log" May 27 20:05:12.079038 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.079001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/egress-router-binary-copy/0.log" May 27 20:05:12.100335 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.100311 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/cni-plugins/0.log" May 27 20:05:12.118651 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.118625 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/bond-cni-plugin/0.log" May 27 20:05:12.140401 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.140369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/routeoverride-cni/0.log" May 27 20:05:12.158425 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.158400 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/whereabouts-cni-bincopy/0.log" May 27 20:05:12.176569 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.176546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj5r_be11dcc3-bbfb-49aa-82d8-a45eaf2da7fa/whereabouts-cni/0.log" May 27 20:05:12.482978 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.482952 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t6cnk_076cfd02-ac02-43cf-bc22-6548333bd8d6/kube-multus/0.log" May 27 20:05:12.604385 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.604353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ssjlj_e4efbc00-a9d7-401c-9c58-71101a6cd3aa/network-metrics-daemon/0.log" May 27 20:05:12.620436 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:12.620407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ssjlj_e4efbc00-a9d7-401c-9c58-71101a6cd3aa/kube-rbac-proxy/0.log" May 27 20:05:13.993532 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:13.993503 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/ovn-controller/0.log" May 27 20:05:14.028382 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.028349 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/ovn-acl-logging/0.log" May 27 20:05:14.052604 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.052567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/kube-rbac-proxy-node/0.log" May 27 20:05:14.087996 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.087968 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/kube-rbac-proxy-ovn-metrics/0.log" May 27 20:05:14.108939 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.108883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/northd/0.log" May 27 20:05:14.131612 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.131582 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/nbdb/0.log" May 27 20:05:14.152675 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.152622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/sbdb/0.log" May 27 20:05:14.319754 ip-10-0-134-76 kubenswrapper[2565]: I0527 20:05:14.319676 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpjx2_9341beac-d749-44e8-91dc-37fc304f9193/ovnkube-controller/0.log"